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(57) ABD-ROM has recorded therein an AVClip gen- 
erated by multiplexing a video stream and a graphics 
stream. The graphics stream represents an Interactive 
display to be overlayed with the video stream, and in- 
cludes a sequence of three Button State groups. The 
interactive display includes a plurality of buttons, each of 
which changes from a normal state to a selected state, 
and from the selected state to an active state, according 



to a user operation. In the three Button State groups in 
the graphics stream, the first-order group (N-ODSs) Is 
made of a plurality of pieces of graphics data, which rep- 
resent normal states of the buttons, the second-order 
group (S-ODSs) is made of a plurality of pieces of graph- 
ics data, which represent selected states of the buttons, 
and the third-order group (A-ODSs) Is made of a plurality 
of pieces of graphics data, which represent active states 
of the buttons. 
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Description 

Technical Field 

5 [0001] The present Invention relates to a recording medium suchasaBD-ROM, and to a reproduction apparatus. The 
present Invention particularly relates to an interactive control technology for combining, with a motion picture made of 
a plurality of pictures, an interactive display made of a plurality of buttons, and for realizing reproduction control in 
accordance with a user operation directed to the buttons. 

10 Background Art 

[0002] The interactive control described above is an Indispensable function for reproduction apparatuses in receiving 
a user operation on selection of title and chapter to be reproduced, a reply to a quiz question, and the like, and Is widely 
known to be realized on DVD reproduction apparatuses. The Interactive control by a DVD reproduction apparatus Is an 

is application of OSD (on screen display) technology by which a button being a character string attached to a graphics Is 
displayed on a screen, and the color of a frame of the button Is changed according to a user operation. Such color 
change enables a user to intultlonally understand which button on the interactive display is in a selected state. 
[0003] A disadvantage of the Interactive control on a DVD is that there Is hardly any factor for amusement. Specifically, 
users hardly find it amusing during operation of the DVD interactive control. In view of such criticism, animation display 

20 of buttons is attempted on the Interactive display of a BD-ROM (Blu-ray disk prerecorded format) whose standardization 
Is underway. To be more specific, In the Interactive display presented by a BD-ROM, each button is presented in a form 
of original animation, and is overiayed with a scene of a movie, which Is the main video Image, in addition, the content 
of this animation display changes according to a user operation. When such an animation display is used to represent 
a character appearing on a movie work, a user can change the expression and action of the character by his operation 

25 directed to the interactive display. Such a kind of animation enables creation of interactive display by which even a child 
is amused. 

[0004] However, the animation display for buttons Incurs a large amount of decoding load, and so there Is a problem 
that a waiting time, until an initial display of the Interactive display is realized, becomes long. For example, assume that 
an interactive display such as shown in FIG .1 is overiayed with a scene of a movie work. This Interactive display has 

30 four buttons, each of which has three states: normal state; selected state; and active state. Also assume a case in which 
each state of button Is presented In 2-3 Seconds of animation display. Even If one page of graphics data is displayed at 
intervals of 5 frames in an Image signal, about 30 pages of graphics data are required to realize 2-3 seconds of animation. 
Not only that, since there are three states for a button (normal state, selected state, and active state), there will be total 
of 90 pages (3*30) of graphics data. So as to dispose four buttons on an interactive display, it requires decoding of 360 

35 pages (4*90), which Is an enormous amount of graphics data Decoding load for one page of graphics data is light 
However, It takes about dozens of seconds so as to decode several hundreds of pages of graphics data. Even for a 
purpose of making amusing Interactive displays, It is too much to keep users waiting dozens of seconds to display each 
Interactive display, which deserves users* criticism. 

ao Disclosure of the Invention 

[0005] The object of the present Invention is to provide a recording medium that realizes Interactive display with 
animation, without delay. 

[0006] So as to achieve the above-described obj ect, the present invention provides a recording medium having: a 
45 graphics stream; where: said graphics stream represents an Interactive display to be overiayed with a motion picture 
made of a plurality of pictures, the interactive display including at least one graphical button material; said graphics 
stream Includes a plurality of pieces of graphics data that are grouped under state sets; and the state sets respectively 
correspond to different states of the at least one button material and are disposed in a sequential order. 
[0007] Under the above construction, suppose there are 360 pages of graphics data for rendering animation, and 
so there are three states for each button material. Then, the graphics data wilt be grouped under three state sets (e.g. 
120*1 20+120 pages). Then each of the state sets Is placed so that the set that appears earlier in the animation will be 
placed nearer to the top, and the set that appears later will be placed farther to the top. Accordingly, in reproduction, the 
earlier appearing button-state set will be loaded to the reproduction apparatus early, postponing loading of later appearing 
button-state sets. By doing so, when once reading/decoding of about 1/3-2/3 of the entire graphics data are complete, 
55 the preparation for an initial display is ready, even though not all of the 360 pages of graphics data have not been finished 
being decoded. 

[0008] This further means that In a case where there is an enormous amount of graphics data to be read/decoded, 
execution of initial display will not be delayed. According to this, the Interactive display with animation can be performed 
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without delay. 

Brief Description of the Drawings 
5 [00091 

FIG.1 illustrates an interactive display composed of animation. 

FIG.2A Illustrates an example of use of a recording medium according to the present Invention. 

FIQ.2B illustrates a key disposition on a remote controller 400, through which a user operation directed to the 
10 interactive display is received. 

FIG. 3 Is a diagram showing a structure of a BD-ROM. 

FIQ.4 Is a diagram schematically illustrating a structure of an AV Clip. 

FIG.5 te a diagram illustrating an internal structure of Clip Information. 

FIG.6 is a diagram illustrating an Internal structure of playUet Information (PL Information). 
15 FIG.7 Is a diagram schematically showing an indirect reference by means of PL information. 

FIG.8A is a diagram illustrating a structure of the interactive graphics stream. 
. FIG.8B is a diagram Illustrating an internal structure of each of an ICS and an ODS. 

FlG.9 Is a diagram illustrating a logical structure constituted by a various kind of functional segments. 

FIG. 1 0A Is a diagram illustrating a data structure of an ODS, which defines a graphics object. 
20 FIG. 1 0B is a diagram Illustrating a data structure of a PDS. 

FIG.1 1 te a diagram Illustrating a data structure of an Interactive Composition Segment. 

FIG.1 2 Is a diagram illustrating a relation between ODSs In a DSn and an ICS. 

FIG.1 3 Is a diagram illustrating a screen composition at a display timing of arbitrary picture data pt1 . 

FIG. 1 4 is a diagram illustrating a setting example 'of button information in ICS. 
25 FIG.15 is a diagram illustrating one example of the state transition of buttons A-D. 

FIG.1 6 Is a diagram Illustrating one example of the design images of the ODSt 1 , 21 , 31 , and 41 . 

FIG.1 7 Is a diagram illustrating one example of the design images of the ODS1 1-19 of the button A. 

FIG.1 8 is a diagram Illustrating one example of ICS and ODS Included in a DS. 

FIG. 19 Is a diagram Illustrating the order of ODSs belonging to a Display Set, as well as button-state sets. 
30 RG.20 is a diagram Illustrating a state transition of an interactive display at which the button-state sets of FIG.1 9 

are disposed; 

FIG. 21 te a diagram illustrating the order of ODSs In a Display Set. 

FIG. 22 Is a diagram Illustrating difference In the order of ODSs In a S-ODSs, between a case when def ault_selected_ 
button_number Is "0", and when Ills "button B\ 
95 FIG.23A and FIG.23B are diagrams for showing the concrete value for ESIZE (DSn [ICS .BUTTON p]D, In a case 

when N-ODSs Include a plurality of ODSs constituting the buttons A-D, and S-ODSs Include a plurality of ODSs 
constituting the buttons A-D. t 

FIG.24 Is a diagram showing a timing of synchronized display by means of ICS. 

FIG.25 is a diagram showing how to set DTS and PTS, in a case when a plurality of ODSs compose an initial display 
ao of an interactive display and the q^ault_selected_bLmon_nurrtber is valid. 

FIG.26 is a diagram showing how to set DTS and PTS, in a case when a plurality of ODSs compose an Initial display 
of an Interactive display, and the default selected button Is Invalid. 

FIG.27 Is a diagram showing the internal structure of a reproduction apparatus according to the present invention. 
FIG.28 Is a diagram showing a storage content of the object buffer 15, In contrast to the graphics plane 8. 
45 FIG.29 te a diagram showing the processing performed by the graphics controller 17 at an initial display. 

FIG .30 Is a diagram showing processing of the graphics controller 1 7 at an update of an Interactive display according 
to IstUserActfori (MoveRight), 

•FIG.31 Is a diagram showing processing of the graphics controller 1 7 at an update of an Interactive display according 
to istUserActlon (MoveDown). 

so FIG.32 is a diagram showing processing of the graphics controller 1 7 at an update of an Interactive display according 

to IstUserActlon (Activated). 

FIG.33 te a timing chart showing pipelining performed by the reproduction apparatus. 

FIG.34 te a timing chart showing pipelining performed by the reproduction apparatus in a case where the default 
■•■ selected button dynamically changes. 
55 FIG.35 Is a flowchart showing the execution procedure for LlnkPL function, performed by the control unit 20. 

FIG.36 te a flowchart showing the procedure of loading processing for Segment 
FIG.37 te a diagram showing one example of multiplexing. 

FIG.38 te a diagram showing the manner in which DS10 is loaded to the coded data buffer 13 of the reproduction 



3 



BP 1868 100 A2 

apparatus. 

FIG.39 Is a diagram showing a case in which a normal reproduction is performed. 

RG.4Q Is a diagram showing how the loading of DS1, DS10, and DS20 is performed when a normal reproduction 
Is performed as In FIG.39. 

5 FIG.41 Is a flowchart in which processing corresponding to the main routine In the processing of the graphics 

controller 1 7 Is described. 

FIG.42tsaftowchartshowingtheprocessingprOMdureforsynchroni2edcontrolperformedby means of a time stamp. 

FIG. 43 Is a flowchart showing the procedure for writing processing directed to the graphics plane 8. 

FIG.44 Is a flowchart showing a processing procedure for auto-actlvatlng a default selected button. 
10 FIG.46 Is a flowchart showing a processing procedure for an animation disp/ay. 

FIG.46 Is a flowchart showing a processing procedure of a UO processing. 

FIG.47 Is a flowchart showing a procedure of changing processing for a current button. 

FIG. 48 is a flowchart showing a procedure of numerical Inputting processing. 

FIG. 49 Is a diagram showing a pipeline In a reproduction apparatus, based on DTS, and PTS In PDS. 
15 FIG. 50 rs a diagram showing a meaning of an END during pipelining of the reproduction apparatus. 

FIG. 51 Is a flowchart showing a production method of a BD-ROM that relates to the second embodiment 

FIG. 52 Is a diagram showing an internal structure of PL Information relating to the third embodiment 

FiG.53 Is a diagram schematically showing synchronization of sub Playltem according to "sync_PtayltemJd,sync 

start_PTS_of_Playltem'. 

zo FIG. 54 is a diagram showing file identification byway of "CllpJnformatlon_fllejiame" within the playllst Information 

on an HD. 

Best Mode for Carrying Out the Invention 
25 (First Embodiment) 

[0010] The following describes an embodiment of a recording medium, relating to the present Invention. Firstly, among 
the embodiments of a recording medium according to the present invention, an example of how the recording medium 
Is used is explained as follows. FIG. 2A Is a diagram Illustrating a use of the recording medium according to the present 

30 Invention. In FIG.2A, the recording medium of the present invention Is a BD-ROM 100. This BD-ROM 100 Is used to 
supply a movie work to a Home Theatre System structured by a reproduction apparatus 200, a television 300, and a 
remote controller 400. Among them, the remote controller 400 is used to receive an operation to change the state of the 
interactive display, from a user, and Is closely related to the recording medium of the present Invention. FIG.2B Illustrates 
keys of the remote controller 400, through which a user operation directed to the Interactive display Is received. As 

35 shown in this drawing, the remote controller 400 Is provided with a MoveUp key, a MoveDown key, a MoveRight key, 
and a MoveLeft key. Here, the buttons on the interactive display have three states: normal state; selected state; and 
actlvestate. The MoveUp key, the MoveDown key, the MoveRight key, and the MoveLeft key are used to receive a user 
operation to change the state of the buttons Into normal state-selected state-active state. The normal state Is a state In 
which mere display Is provided, whereas the selected state Is a state In which a foous Is given according to a user 

40 operation, but confirmation has not been received. The active state Is a state In which confirmation is received. The 
MoveUp key Is for, when a button in the Interactive display is in a selected state, setting a button above this selected 
button, to be In a selected state. The MoveDown key Is for setting a button below this selected button to be In a selected 
state. The MoveRight key Is for setting a key on the right of the selected key to be In a selected state, and the MoveLeft 
key te for setting a key on the left of the selected key to be In a selected state. 

45 [0011] The Activated key Is for setting the selected button to be In an active state (I.e. to activate). Numerical keys 
*0*-"9" are for setting a button to which a corresponding number Is assigned, to be In a selected state. V10" key Is for 
receiving an operation to add 1 0 to the already inputted numerical values. It should be noted here that "0" key and "+1 0" 
key are both for receiving Input of numerical value of no smaller than 1 0 digits. Therefore any one of them Is enough for 
the remote controller 400. 

so [0012] So far, the description Is about how the recording medum of the present Invention Is used. 

[0013] As follows, among the embodiments of the recording <d1um of the present Invention, a production example 
Is explained. The recording medium of the present Invention ::. produced by Improving the application layer of a BD- 
ROM. FIG.3 Is a diagram showing a structure of a BD-ROM. 

[0014] In the drawing, the BD-ROM Is shown at a fourth row of the drawing, and a track on the BD-ROM Is shown In 
ss the third row. The track Is actually In a spiral shape on the disk, but shown as a line extending In the lengthwise direction 
of the drawing. The track includes a lead-in area, a volume area, and a lead-out area. The volume area In this drawing 
has a physical layer, a file system layer, and an application layer. In the first row of the drawing, an application format 
of the BD-ROM Is Illustrated using a directory structure. As Illustrated In the drawing, the BD-ROM has a directory BDMV 
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under the root directory, and the 8DM V directory contains such files as XXX.M2TS, XXX.CLPI, and YYY.MPLS, By 
forming the above application format, It Is possible to produce the recording medium according to the present Invention, 
In a case In which there Is more than one file for each kind, It is preferable to provide three directories named STREAM, 
CLIPINF, and PLAYLIST under the BDMV to store the files with the same extension in one directory. Specifically, It Is 
s desirable to store the files with the extension M2TS In the STREAM, the files with the extension CLPI in the CLIPINF, 
arid the files with the extension MPLS In the PLAYLIST. 

[0015] TVs follows, each file in the application format Is explained. Firstly, an explanation aboutthe AV Clip (XXX.M2TS) 
is given. 

[0016] The AV Clip (XXX.M2TS) is a digital stream In MPEG-TS format (TS Is Transport Stream) obtained by muffl- 
'0 plexlng a video stream, at least one audio stream, a presentation graphics stream, and an interactive graphics stream. 
The video stream represents motion pictures of the movie, the audio stream represents sound of the movie, the pres- 
entation graphics stream represents subtitles of the movie, and the Interactive graphics stream represents dynamic 
reproduction control procedure directed to menus. FIG.4 is a diagram schematically illustrating a structure of the AV Clip. 
[0017] The AV Clip (middle row) Is structured in a following manner. A video stream made of plural vide frames (pictures 
16 PP . PJ 2, and p|3), and an audio stream made of plural audio frames (top row of the drawing) are respectively converted 
into a PES packet sequence (second to top row of the drawing), and then Into a TS packet sequence (third to top row 
of the drawing). Then a presentation graphics stream and an Interactive graphics stream (bottom row of the drawing) 
are converted Into a PES packet sequence (second to bottom row of the drawing), and then into a TS packet sequence 
(third to bottom row of the drawing). The TS packet sequences are multiplexed, to obtain the AV Clip. 
20 poi8] The AV Clip constituted In the above manner is divided Into more than one extent, like ordinary computer files, 
and stored In areas In the BO ROM. The AV Clip is made of one or more ACCESS UN fTs. Each ACCESS UNIT functions 
as a unit of random access, as well as a decoding unit starting with an Intra (I) picture. 

[0019] Clip Information (XXX.CLPI) Is management Information for an AV Clip. FIG. 5 Is a diagram illustrating an 
Internal structure of the Clip information. Since an AV Clip Is obtained by multiplexing a video stream and an audio 
25 stream, and has ACCESS UNITS that each functions as a unit of random access, specific Items managed by the Clip 
information are: attributes of each of the video stream and the audio stream; and at which position In the AV Clip a 
random access point exists. 

[0020] In the drawing, the broken leader lines help clarify a structure of the Clip information. As the leader line hn1 
shows, the Clip information (XXX.CLPI) Is comprised of: "attribute information" about the video stream and the audio 
30 stream: and "EP_map" being a reference table used in making a random access to the ACCESS UNITs. 
[Q021] A6theleaderlinehr£shpW8,thea^ 

that Is attribute information on a video stream; "Number* indicating the number of sets of attribute Information; and "Audio 
attribute information #1-#m" that each representing attribute Information for a corresponding one of a plurality of audio 
streams to be multiplexed onto the AV Clip. As the leader line hn3 shows, the Video attribute Information indicates what 

35 kind of compression method was employed to compress the video stream (Coding), and a resolution (Resolution), an 
aspect ratio (Aspect), and a frame rate (Framerate) for each set of picture data constituting the video stream. 
[0022] As the leader line hn4 shows, audio attribute information^ -#m(attiibuteinf ormattcn on the audio stream) indi- 
cates what kind of compression method was employed to compress the audio stream (Coding), a channel of the audio 
stream (Ch.), which language the audio stream corresponds to (Lang), and a sampling frequency of the audio stream. 

40 [0023] EP_map Is a reference table used for performing indirect reference to the addresses of a plurality of random 
access points, us ing time information. As the leader fine hn5 shows, the EP_map is comprised of: a plurality of sets of 
entry information (ACCESS UNIT#1 entry,ACCESS UNIT#2entry, ACCESS UNIT#3 entry...), and entry number 
\ (Number). As the leader line hn6 shows, each entry Indicates a reproduction start time of a corresponding ACCESS 

UNIT and the address of the ACCESS UNIT, in association (Note that it is possible to enter the size of the first I picture 

45 in the ACCESS UNIT (l-slze)). A reproduction start time of an ACCESS UNIT Is expressed by a time stamp of picture 
data positioned at the beginning of the ACCESS UNIT (presentation time stamp). In addition, an address of an ACCESS 
UNIT Is expressed by a serial number of a corresponding TS packet (SPN(Source Packet Number)). In coding,, the 
• variable length coding compression method is adopted. Therefore, even If there are varieties In size and reproduction 
time between each ACCESS UNIT Including GOP, It becomes possible to perform random access, from any reproduction 

so time, to the picture data of the ACCESS UNIT corresponding to a destination reproduction time, by referring to the entry 
of this ACCESS UNIT. 

[0024] Note that the file name XXX In XXX.CLPI Is Identical to the name of an AV Clip whose Clip Information matches. 
For example, the file name of the AV Clip in this drawing is XXX, and so it corresponds to the AV Clip (XXX.M2TS). 
Next, pteyllst information (PL Information) is explained. 
55 [0025] YYY.MPLS (playlist information) is a table constituting a pteylist being reproduction path information, and is 
comprised of a plurality of pieces of Play Item information (Playltem Information*! ,#2,E3.. .#n), and Playltern information 
number (Number). FIQ.6 is a diagram illustrating an internal structure of playllst information. One piece of Playltem 
information defines one or more logical reproduction sections that constitute a playlist. The leader line hsl in the drawing 
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helps clarify a structure of one piece of Playltem Information. As this leader line shows, the piece of Play Item Information 
Is comprised of: "Clipjnformatlon J1le_name # representing a file name of reproduction section Information of an AV Clip 
to which the In-polnt and Out-polnt of the reproduction section belongs; "Cllp^ccdecJdentJfler" representing a coding 
method used to encode the AV Clip; *IN_tlme" being time Information Indicating a start point of the reproduction section; 

s and •OUT_po1nr being time Information Indicating an ending point of the reproduction section. 

[0026] The Playltem Information Is characterized by Its notation method. Specifically, In the Playltem Information, 
reproduction sections are defined in an Indirect way by means of time, using the EP_map as a reference table. FIG.7 
Is a diagram schematically Illustrating this Indirect reference. In this drawing, an AV Clip Is comprised of a plurality of 
ACCESS UNITs . The EP_map of the Clip Information specifies the addresses of the ACCESS UNITe as shown by the 

10 arrows ayl , 2, 3, and 4. The arrows Jy1 , 2, 3, and 4 schematically show how the pieces of Playltem Information are used 
to make a reference to the ACCESS UNITs. In other words, reference made by means of the pieces of Playltem 
Information (I.e. the arrows Jy 1 , 2, 3, and 4) is able to specify the addresses of ACCESS UNITS within the AV Clip, via 
the EP_map, and so can be regarded as an indirect reference using time concept by means of EP__map. 
[0027] A reproduction section on a BD-ROM, comprised of a combination of Playltem information, Clip Information, 

is and AV Clip Is celled "Playltem". A logical reproduction unit on a BD-ROM, comprised of a combination of PL Information, 
Clip Information, and AV Clip la called "playllst" (abbreviated as PL). A movie work recorded In a BD-ROM Is' structured 
by such logical reproduction units (!•©. PL). Therefore, it Is easy to produce another movie work made of all the scenes 
with a character, by defining PLs specifying scenes with the character. 

[0028] Because movie works recorded in BD-ROMs have the aforementioned logical structure, quoting of an AV Clip 
so constituting a scene of a movie work In another movie work can be efficiently performed. 
[0029] Next, the interactive graphics stream is described. 

[0030] FIG.8A is a diagram Illustrating a structure of the interactive graphics stresra The first row represents a TS 
packet sequence constituting the AV Clip. The second row represents a PES packet sequence constituting the graphics 
stream. The PES packet sequence In the second row is structured by extracting payloads from TS packets of the first 
25 row that Include a predetermined PID, and then linking the extracted payloads together. Note that the presentation 
graphics stream is not a main focus of the present invention, and so Is not explained here, 

[0031] The third row represents the structure of the graphics stream. The graphics stream Is made of functional 
segments of: ICS(lnteractlve Composition Segment); PDS (Palette Definition Segment); ODS (ObJect_Deflnltlon_Seg- 
ment), and END (END of Display Set Segment). Among these functional segments, ICS Is called a display composition 
so segment, and PDS, ODS, and END are respectively called a definition segment. The PES packet and each of the 
functional segments correspond one to one, or. one to plurality. In other words, onef unctional segment is either recorded 
In the BD-ROM after converted Into one PES packet, or after divided Into fragments and converted Into more than one 
PES packet. 

[0032] FIG.8B Is a diagram Illustrating PES packets obtained by converting the functional segments. As FIG.8B shows, 
ss a PES packet is made of a packet header and a paytoad, where the payload is the substance of a functional segment 
In addition, the packet header Includes a DTS and a PTS corresponding to this functional segment. Hereinafter, DTS 
and PTS Included In a packet header are referred to as DTS and PTS of a functional segment. 
[0033] These various kinds of functional segments constitute a logical structure as shown in FIG. 9. In this drawing, 
the third row represents functional segments, the second row represents Display Sets, and the first row represents 
<o Epochs. 

[0034] The second row Is a collection of Display Sets (abbreviated as "DS"). each of which corresponds to graphics 
that make up one screen of graphics. The broken line In the drawing indicates to which DS the functional segments of 
the third row belong. As can be understand from the above, a series of functional segments of "ICS-PDS-QDS-END" 
constitutes one DS. A reproduction apparatus can constitute one screen of graphics by reading a series of functional 

45 segments constituting one DS, from the BD-ROM. 

[0035] Each Epoch In the first row represents a period having memory management continuity on a reproduction time 
axis for an AV Clip, and also corresponds to a data set assigned to thte period. Here the assumed memory Is a graphics 
plane that is for storing one screen of graphics, or an object buffer for storing graphics data In decompressed state. By 
stating a graphics plane or an object buffer has memory management continuity, It Is meant that a flash does not occur 

so m the graphics plane or In the object buffer In a period represented by the Epoch, and deletlon/re-drawlng for graphics 
Is performed only within a predetermined rectangular area within the graphics plane (Here, the flash means clearing all 
the contents stored In the plane or In the buffer). The size (length/Width) and position of this rectangular area are fixed 
throughout an Epoch. As long as deletlon/re-drawlng of graphics Is performed within this fixed area of the graphics plane, 
seamless reproduction Is guaranteed: That Is, an Epoch can also be considered as one unit on a reproduction time axis, 

55 at which seamless reproduction Is guaranteed, rf a user wants to change the area, he has to define a change time on 
the reproduction time axle, and create a pew Epoch that corresponds to the time after this change time. In this case, 
seamless reproduction wHI not be guaranteed between these two Epochs. 

[0036] Note that what Is meant by "seamless reproduction" Is that deletlon/re-drawlng of graphics will complete within 
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a predetermined video frame number, r^br an Interactive graphics stream, this video frame number is 4 to 5 frames. This 
number of video frames is determined by a ratio of a fixed area to an entire graphics plane, and a transfer rate between 
the object buffer and the graphics plane. 

[0037} In the drawing, the broken lines hk1 , 2 representto which Epoch the functional segments in the third row belong. 

5 As can be understood from this drawing, a series of DS (namely, Epoch Start, Acquisition Point, and Normal Case) 
constitutes an Epoch of the first row. "Epoch Start' , "Acquisition Point" , and "Normal Case" are respectively a type of 
DS. Note that the order of "Acquisition Point" and "Normal Case" is merely one example, and can be. reversed. 
[0038] "Epoch Start" is a DS thatproduces a display effect of "new display", and indicates a start of a new Epoch. 
Therefore an Epoch Start has to Include all the functional segments required to compose a next screen, and is disposed 

io et a position In an AV Clip, which is destined for a random access target (e.g. chapter of a movie work). 

[0039] "Acquisition Point" is a Display Set that produces a display effect of "display refresh", and relates to a preceding 
"Epoch Start". The Acquisition Point is classified into two types: Duplicate and Inherit. A Duplicate is a Display Set totally 
identical to a preceding Epoch Start, whereas an inherit is a Display Set inheriting the functional segments from a 
preceding Epoch Start but has different button commands from the preceding Epoch Start. Although not representing 

15 a start time of an Epoch, an Acquisition- Point DS includes all the functional segments required to compose a next screen. 
Therefore if a random access is performed to an Acquisition-Point DS, graphics display is guaranteed. In other words, 
an Acquisition- Point DS enables a screen composition during an Epoch in progress. 

[0040] An Acquisition-Point Display Set Is Incorporated into a position that is a random access target Such a position 
can be specified by time search. Time search is an operation in which Input of time (minute and second) Is received 
20 from a user, and random access is made to a reproduction time corresponding to the inputted time. Such time input is 
performed in a rough unit such as 1 0 minutes or 1 0 seconds, and so time search can specify reprockiction points in 1 0 
minutes Interval or 10 seconds Interval. By providing Acquisition Points at positions that can be specified by the time 
search, graphics stream reproduction will be facilitated at the time search. 

[0041] "Normal Case" is a DS that produces a display effect of "display update", and only Includes a difference with 
25 the prior display composition. For example, suppose that a button for a DSv has a same image design as a preceding 
DSu, but Is under different state control from the DSu. In this case, the DSv is arranged either to only include ICS, or to 
only include ICS and PDS, and set the DSv as a Normal-Case DS. By doing so, It is not necessary to provide overlapping 
ODSs, and so helps reduce the occupied areas in a BD-ROM. Note that a Normal-Case DS cannot compose a screen 
by Itself , because it represents only the Difference, 
30 [0042] An Interactive display defined by these DS is created by disposing GUI parts on a screen. By stating that a DS 
has interactivity, it means that the state of the GUI parts is changeable in accordance with a user operation. In the present 
embodiment, such GUI parts, which are a user operation target, are called "button". The states of a button Include 
•normal state", "selected state", and "active state", each of which is composed by a plurality of graphics in decompressed 
state. Each decompressed graphics representing a state of a button is called "graphics object*. The reason why one 
35 state of each button is represented by a plurality of decompressed graphics is for the purpose of animation display. 
[0043] Next, the Definition Segments (ODS, PDS) are explained. 

[0044] "ObjecUDeflnltion^Segmenr is information defining a graphics object. The following explains this graphics 
object. An AV Clip, recorded in a BD-ROM, features high-quality Images that can be compared to those of a hlgh- 
definltion television. Accordingly, the resolution of the graphics object is high, which is 1 920*1 080 pixels, so as to produce 
<o a high definition. As for the color of a pixel, an Index value for one pixel is set as 8 bit length. Here, the Index value 
Includes red color-difference component (Cr_value), blue color-difference component (Cb_va|ue) , brightness component 
(Y_value), and transparency level (T.value). By this setting, arbitrary 256 colors can be selected from 16.777,21 6 colors 
<f ull color), thereby enabling setting of the 256 colors as colors for the pixel. 

[0045] An ODS has a data structure as shown. In FIG. 1QA, for defining a graphics object. An ODS Is comprised of: 
45 "segmentjype" that Indicates that It Is an ODS; "segmant_length p that indicates a data length of the ODS; •obJect_id ,, 
that uniquely Identifies the graphics object that corresponds to this' ODS in the Epoch; "object_verslon_number" that 
Indicates a version of the ODS In the Epoch; "last in sequence flag"; and a continuous byte-length data "object_data_ 
fragnent" that is either a part or alt of the graphics object 

[0046] "objected" uniquely identifies the graphics object that corresponds to this ODS In the Epoch. However, when 
so animation is constituted by a plurality of graphics objects defined by a plurality of ODSs, "objectjd" assigned to each 
of the plurality of ODSs will be serial numbers. 

[0047] Next, "last in sequence flag" and "object.datajragmenf are explained. There is a case where decompressed 
graphics constituting a button cannot be stored In one ODS, because of a constraint on the payload of a PES packet 
In such a case, a division (fragment) of a button command Is set as "ob]ect_data_fraojnhent". When storing one graphics 
. 55 object in a plurality of ODSs, all the fragments have to have the same size, except the last fragment That is, the last 
fragment will have smarter size than the other fragments. The plurality of ODSs storing these fragments will appear In 
the Identical order in a DS. The last part of the graphics object Is specified by an ODS having "last in sequence flag". 
The above-described data structure of an ODS assumes adoption of a storing method by which storing for a new PES 
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packet does not start until a current PES packet becomes full However, It Is also possible to adopt a storing method by 
which there will be empty space in each PES packet, 

[0048] "palette_definrt)on_segment (PDS)" Is Information that defines a palette for color conversion. A data structure 
of a PDS Is shown In FIG.10B. As shown by FIG. 108 f a PDS Is comprised of: "segment^type* that indicates that it Is a 

5 PDS; "segmentjength" that Indicates a data length of the PDS; •palette Jd" that uniquely Identifies the palette Included 
in the PDS; "palette_verslon_number" that Indicates a version of the PDS in the Epoch; and •patette^entry" that Is 
information about each entry. "palette_entry" represents a red color-cliff ere nee component (Cr.value), blue color-differ- 
ence component (Cb_value), brightness component (Y_value), and transparency level (T_va1ue), for each entry, 
[0049] Next, END of Display Set Segment Is explained. 

io [0050] END of Display Set Segment is an index Indicating an end of a Display Set transfer, and Is disposed Immediately 
after the last ODS. The internal structure of this *END of Display Set Segment" is. comprised of: segment_type that 
indicates that this functional segment Is an END of Display Set Segment; and segmentjength that Indicates a data 
length of the functional segment, which do not require particular explanation. Therefore the drawing does not show the 
Internal structure. 

is [0051] Next, an Interactive Composition Segment (ICS) is explained. An ICS is a functional segment constituting an 
interactive display. An ICS has a data structure shown in FIG.1 1. As shown in this drawing, an ICS is comprised of: 
segment Jype; segmentjength; composltlon_number; compos1tlon_state; commandjjpdatejlag; composition^ 
tlmeout_PTS;selectionjlmeout_PTS;UO_maskja bte; anlmatlonJrame_rate_code; default_selectecLbutton_ 
number; default_actrvated„button_number and "button information set (button info (1) (2) (3)). 

20 [0052] •compositk>n_number" indicates whether update is performed In the DS to which the ICS belongs, and takes 
a number from 0 to 15. 

[0053] "composltlon_8tate" Indicates whether the DS that starts with the particular ICS Is a normal case, acquisition 
case, or epoch start. 

[0054] 'commandjjpdatejlag" Indicates whether the button commands In the ICS have any change from the coun- 
ts terparts of the preceding ICS. For example, when a DS that a certain ICS belongs to is an Acquisition Point, the ICS will 
have the same content as the immediately preceding ICS, in principle. However, when this command.updatejlag Is 
set to be ON, it becomes possible to set, in the ICS, a button command different from the preceding DS. By this flag, a 
preceding graphics object can be appropriated, however the command gets valid when It Is instructed to be changed. 
[0055] "composition Jlmeout_PTS" describes an ending time of an Interactive display by means of buttons. At the 
30 ending time, display of the Interactive display Is no more valid, and therefore Is not presented, composition jlmeout_ 
PTS Is preferably described In a time accuracy of the reproduction time axis for the motion picture data. 
[0056] "selection Jlmeout. PTS" describes an ending time of a valid button selection period. At the time shown by the 
selection jlmeout_PTS, a button specified by def ault_actlvated_button_number gets activated, selection j1meout_PTS 
Is equal to the time specified by composition jlmeout_PTS or shorter, selection jlmeout_PTS Is described In a time 
35 accuracy of a video frame. 

[0057] "UO_maskjable" Indicates permisslon/non-permlsston of a user operation In a Display Set corresponding to 
an ICS. When "non-permlsslon" is set In this mask field, any user operation dlrectedto a reproduction apparatus becomes 
Invalid. 

[0058] B anlmatlonJrame_rate_code" describes a frame rate to be applied to a button displayed In animation. The 
#> animation frame rate Is given by dividing the video frame rate by a value of this field. If this field indicates a value of 00, 
only ODS Identified by start_objectJoLxxx Is displayed and In non-animation, among the ODS defining graphics objects 
for all the buttons. 

[0059] "defaurt_setectedj3utton_number* Indicates a button number whose default is to be set in a selected state at 
the start of an Interactive display. When this field Indicates 0, the button assigned a button number stored In the register 
45 of a reproduction apparatus Is set to be an active state automatically, ff this field indicates other than 0, the field Is 
interpreted to Identify a corresponding button. 

[0060] "defaulLactrvated J>utton_nurnber Indicates a button to be set In active state automatically, In a case when a 
user has not set any button In active state within the time defined by the selection Jim eout^PTS. When the default, 
activated J>utton_number indicates "FF, the button currently In selected state Is automatically selected at the time 
so defined by the selection Jimeout^PTS. When the def ault_acti vated_button_n umber Indicates "00", the automatic selec- 
tion is not performed. When the defauCactivateoLbutton jiumber Indicates other than "00" and "FF", then this field is 
interpreted to Identify a corresponding button. 

[0061] "button Information (buttonjnfo) Is information defining each button to be overtayed In an Interactive display. 
In the drawing, the leader line hpl helps clarify the internal structure of the button Information /, which is Information about 
5* the Ith button to be controlled by the ICS (button f). The following Is an explanation on Information elements constituting 
this button Information /. 

[0062] "button.number" Is a numerical value uniquely Identifying a button / In an ICS. 
[0063] "numertcajly_selectablejlag" tea flag Ino^ 
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[0064] "auto_actlon Jlag" Indicates whether to automatically set the button / to be active state. When auto^action^ 
flag Is set to be ON (he. bit value of 1 ), the button / is set to be In active state, instead of selected state. When the auto_ 
action.flag is set to be OFF (I.e. bit value of 0), the button / will be in mere selected state even when the button / Is 
actually selected. 

5 [0066] "ob]ect_hort2ontal_posWon' t "ob)ect_vertlcaJ_pos1 tion" respectively indicate a horizontal position and a vertical 
position of the upper left pixel ol the button fin an interactive display; 

[0066] •upper_button_number - indicates a button number to be in selected state, instead of the button /, when the 
MOVEUP key ispressed while the button / is In selected state. If the number for the button / Is set in thisf ield, the press 
of the MOVEUP key is Ignored. 
io [0067] •|owerjDUtton_number J \ "lefL.button_number", and •right u _button_n umber* respectively indicate the button 
numbers to be inselectedstate, Instead of the button /, when the MOVEDOWN key, the MOVELEFT key. the MOVE RIGHT 
key are pressed while .the button / Is in selected state. When the number for the button / Is set In this field, the press for 
these keys is Ignored. 

[0068] "start_pbject Jd_normal" Indicates the first number of serial numbers assigned to a plurality of ODSs constituting 

is animation, when the button / In normal state is to be drawn In animation. 

[0069] #, end_objectJd_normar indicates the last number of the objectjd being the serial numbers assigned to the 
plurality of ODSs constituting the animation, when the button / in normal state is to be drawn In animation. If the ID 
indicated by this end_obJecUcLnormal is Identical to the ID indicated by the start_object Jd_normal, then the still image . 
corresponding to a graphics object identified by this ID will be the image design of this button /. 

20 [0070] ■repeated_normaUiag ,, Indicates whetherto repeatedly continue the animation display for the button/in normal 
state. 

[0071] 'start_ob)ect_!d_selected' indicates the first number of the serial numbers assigned to the plurality of ODSs 
constituting anlmatlonTwhen the button Mn selected state is drawn in animation, if the ID indicated by end_objectJcL 
selected is Identical to the ID Indicated by this starLobJect,ld_selected, then the still Image corresponding to a graphics 
2s object identified by this ID will be the image design of this button /. 

[0072] "end_obJectJoLselected" indicates the last number of the objectjd being the serial numbers assigned to the 
plurality of ODSs constituting the animation. 
[0073] "repeat_se1ectedjlag" Indicates w^ 

state. When start j>bjectjd_selected has the same yalue as end_objecL.ld_selected, 00 is set In this field. 
30 [0074] B starL.ob]ecl_ld_actlvated 0 Indicates the first number of the serial numbers assigned to the plurality of ODSs 
constituting animation, when the button / in active state is drawn In animation. 

[0075] "end_objectJd_actrvated" Indicates the last number of objectjd being the serial numbers assigned to the 
plurality of ODSs constituting animation, when the button In active state Is drawn In animation. 
[0076] Next, the button commands are explained. 
35 [0077] "button command (buttoh_command)" Indicates a command to be executed when the button / is put into active 
state. 

[0076] The button command can Instruct a reproduction apparatus to perform reproduction directed to PL and Play Item. 
A command that instructs a reproduction apparatusto perform reproduction directed to PL and Play Item is called "Lin kPL 
command" . This command can start reproduction of a playltet specified by a first argument, from a position specified 
to by a second argument . 

[0070] Format LlnkPL(flrst argument, second argument) 

[0080] The first argument specifies, by means of a number assigned to a pteyiist, a PL to be reproduced. The second 
argument specifies a reproduction start position, by means of a Playltem included in the PL, or a chapter and a mark 
that are included in the PL. 

45 [0O81 ] A LinkPL function for specifying a reproduction start position by means of Playltem Is expressed as "UnkPLat- 
PlayltemO". 

[0062] A LinkPL function for specifying a reproduction start position by means of Chapter Is expressed as "LinkPLatCh- 
apterO* 

[0083] A LinkPL function for specifying a reproduction start position by means of Mark is expressed as "UnkPLatMark 
so ()•. 

[0084] A button command Is used to give instructions to a reproduction apparatus to perform a state obtaining and a 
state setting. A state of a reproduction apparatus Is Indicated by 64 Player Status Registers (whose set value is called 
PSR), and 4096 General Purpose Registers (whose set value is called GPR). The button command is classified into the 
following (l)-0v). and performs setting of a value to these registers, and obtaining of a value from these registers. 

55 

(I) "Get value of Player Status Register" command 

[0085] Format Get value of Player Status Register (argument) 
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[0086] This function Is used when obtaining a set value of a Player Status Register specified by an argument. 

(II) "Set value of Player Status Register command 

s [0037] Format Set value of Player Status Register (first argument, second argument) 

[0086] The function Is used when setting a value specified by a second argument to a Player Status Register specified 
by a first argument. 

(ill) 'Get value of General Purpose Register" command 

10 

[0089] Format Get value of General Purpose Register (argument) 

[0090] This function Is used when obtaining a set value of a General Purpose Register specified by an argument. 
(Iv) "Set value of General Purpose Register command 

15 

[0091] Format Set value of General Purpose Register (first argument, second argument) 

[0092] This function Is used when setting a value specified by a second argument to a General Purpose Register 
specified by a first argument. 

[0093] Next, a concrete example of interactive control performed by such an ICS Is explained. This concrete example 
zo assumes the ODSs and the ICS as shown in FIG. 12. FIG. 12 la a diagram Illustrating a relation between ODSs In a 
DSn, and an ICS. This DSn Is supposed to include ODS1 1 -1 9, 21 -29, 31 -39, and 41 -49. Among these ODSs, ODS1 1 -1 9 
draw each state of a button A. ODS21-29 draw each state of a button B. ODS31 -39 draw each state of a button C, and 
ODS41-49 draw each state of a button D (as shown by a sign "]" In the drawing). In addition, button_info(1 ),(2),(3),(4) 
respectively indicate the state control of these buttons A-buttons D (Refer to the arrows bh1 ,2,3,4 in the drawing). 
26 [0094] When the execution timing of the control by means of this ICS coincides with a display timing of any picture 
data pt1 , which Is among the pictures of FIG. 13, an interactive display tml made of buttons A-D Is displayed (gs2) by 
being overfayed (gs1) with this picture data pt1. An Interactive display made of a plurality of buttons is displayed in 
accordance with the content of a motion picture. Therefore an ICS can realize realistic effect with use of buttons. 
[0095] FIG .14 illustrates a description example of an ICS when the state transition of the buttons A-D (shown In FIG. 
so 16) Is performed. 

[0096] )n FIG. 15, arrows hh1 and hh2 symbolically represent a state transition by means of neighbor_lnfo( ) of button 
info(1 ). In the neighborjnf o( ) of the button Into (1 ), the lower_button_number Is set as "button C" , and so the button 
C will be In selected state (s]l of FIG.15) if an UO of MOVEDOWN key press occurs while the button A Is In selected 
state (upl of FIG.15). In the nelghbor_lnfo( ) of the button info (1), the rtght_button_number is set as "button B" , and 
as so the button B will be in selected state (s]2 of FIG. 15) If an UO of MOVERIGHT key press occurs while the button A 
is In selected state (up2 of FIG.15). 

[0097] The arrow hh3-ln FIG.15 indicates a state transition control by means of nelghborJnfo( ) of the button Info (3). 
In the neighborJnfo( ) of the button Info (3), upper_button_number is set as "button A", and so the button A will return 
to the selected state if an UO of MOVEUP key press occurs while the button C Is In selected state (up3). 

*o [0098] Next/ the Image designs of the buttons A-D are described. Suppose here that ODS1 1,21,31, and 41 have the 
Image designs shown in FIG. 16, and that the ODS11-19 assigned to the button A have the Image designs shown In 
FIG.17. Because, In the normaLstateJnfo() In the buttonjnfo (1) of the ICS, start_ob)ecUd_normal and end_obJect_ 
ld_n ormal specify ODS1 1-13, and so the normal state of the button A Is presented in animation according to the O DS1 1 - 1 3. 
In addition, in the selected_state Jnfo() of the button_lnfo(1) f start_obJecU deselected and end^obJectJcLselectedspec- 

45 rfy ODS14-16, and so the selected state of the button A is presented according to the ODS14-1 6. When a user puts the 
button A into selected state, the Image design of the button A will change from the design according to the ODS1 1 -1 3, 
to the design according to the ODS14-1 6. Here, in the normaLstate Jnfo() and the selected_stateJnfoO, If the repeat, 
normal Jlag and repeat_select_f lag, are set asl , the animation according to the ODS1 1 -1 3. and the animation according 
to the ODS14-16 will be repeatedly continued respectively, as shown by "-►(A) 0 , °(A)-» W , and •-►(B)", °(B)-^° in the 

so drawing. 

[0099) if a plurality of ODSs presentable In animation are assigned to the buttons A-D, and that the control for these 
ODS Is described In the ICS, realistic-looking button state control will be realized (e.g. to change the expression of a 
character according to each user operation). 
[0100] Next, application of numerfcally_selectabJe_flag is described. 
55 [0101] FIG.1B ie a diagram Illustrating one example of ICS and ODS Included In a DS. In this drawing, the 0DS31-33 
respectively Indicate a portrait, a name, and a uniform number of a corresponding one of three baseball players shown 
In the top row of the drawing. The ICS to which this DS belongs Includes three sets of button Information, where the 
button Information (1 ) ' s start_obJecUd is set to Indicate the ODS31 , the button information (2)'s start_obJectJd la set 
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to Indicate the ODS32, and the button information (3)'s stariLobjectJd is set to indicate the ODS33. In addition, the 
{ button information (1 )*s button number Is set as £9, the button information (2)'s button information is set as 42, and the 

button Information (3)'s buttori information is set as 94. Furthermore, for all the button information (1 )-(3), the numerically- 
\ selectable_f lag is set as 1 . This means that any of the buttons corresponding to the button Information (1 )-(3) Is selectable. 

5 Therefore If the numerical value of "99 - Is Inputted by a user through the remote controller 400, the button corresponding 
to Mr. Beginner's Luck will be put to selected state. The Input of the numerical value "99" may be received through 
sequential press of "9" and "9". Alternatively, it may be realized by a combination of a press of "9" and 9 times of press 
directed to >10" key. When the numerical value of "42" Is inputted, the button for Mr. Careless Mistake will be put to 
selected state, and when the numerical value of "94" Is Inputted, the button for Mr. Dead Stock will be put to selected state. 
10 [0102] When auto_actk>n_ftag for these pieces of button Information (1)-(3) are set as 1, these pieces of button 
information (i)-(3) will be put to active state, instead of put to selected state, and the button commands Included therein, 
namely (LinkPL(PL#21), LinkPL(PL#22), UnkPL(PL#23)) will be executed. When the link destinations PL#21, #22, and 
#23 of the button commands, included in the three pieces of button Inf ormation, are batting/throwing scenes of respective 
players, then these batting/throwing scenes will be reproduced In response to an Input of a numerical value corresponding 
is to the uniform number of a corresponding player. Since it is possible to select buttons directly using a uniform number 
that is weB-known, the user operabllity will remarkably Improve; 

[0103] Next, the order of ODSs In a Display Set Is described. As described above, each ODS belonging to a Display 
Set is specified by an ICS to display one state of a button. The order of ODSs in a Display Set is decided according to 
such a specification, i.e. which state of a button an ODS represents. 
20 [0104] To be more specific, ODSs in a Display Set are classified into sets of (1 ) those representing normal state, (2) 
those representing selected state, and (3) those representing active state. A set of ODSs that represents one state of 
a particular button is called 'button-state set'. These button-state sets are disposed In the order of "normal state-selected 
state-active state". As shown above, the order of each ODS in the Display Set is decided according to which state of a 
button the ODS represents. 

25 [0105] FIG. 1 9 Is a diagram illustrating the order of ODSs belonging to a Display Set Inthe second row of this drawing, 
three button-state sets in the Display Set are illustrated. This drawing depicts: a set of ODSs for rendering normal state 
of the buttons (ODSs for Normal state); a set of ODSs for rendering selected state of the buttons (ODSs for Selected 
state); and a set of ODSs for rendering active state of the buttons (ODSs for Active state). The order of these button- 
state sets Is as follows: normal state->selected state-^actlve state. The purpose of this orderls for facilitating reading 
30 of the ODSs constituting an Initial display of an interactive display early, putting off the reading of the ODSs constituting 
a screen display after update. 

[0106] The first row of FIG. 19 represents graphics objects An, Bn, Cn, Dn, As, Bs, Cs, Ds, Aa, Ba, Ca, Da, which will 
be rendered by these button-state sets. The subscript *n" assigned to An, Bn, Cn, Dn represents normal state of a 
corresponding button. In the same manner, the subscript "s" of As,Bs,Cs,Ds represents selected state of a corresponding 
35 button, and the subscript "a" represents active state of a corresponding button. The second row of FIG.1 9 shows button- 
state sets to which the Graphics Objects of the first row belong. It should be noted that, in this drawing, the sets of ODS1 - 
ODSn respectively belonging to N-ODSs, S-ODSs, and A-ODSs are assigned the same number to each other, (I.e. 
there Is ODS1 belonging to N-ODSs, and at the same time, there is ODS1 belonging to S-ODSs.), However, each set 
Is different from one another. This also applies to every similar drawing hereinafter. 
*o [0107] FIG.20 is a drawing illustrating a state transition of an interactive display at which the button-state sets of FIG. 
19 are disposed. 

[0108] The interactive display In this drawing has a plurality of states, namely, "initial display", "update display by 1* 
user action", and "update display by 2*"* update display". The arrows In the drawing represent user actions that trigger 
. the state transition. By this drawing, the four buttons A, B, C, and D respectively have three states of "normal state - , 
45 "selected state", and "active state". Among them, what is necessary for an initial display is three graphics objects for 
rendering a normal state and one graphics object for rendering a selected state. 

[0109] Even when the default selected button Is not decided yet, and it is uncertain which of the buttons A-D will be 
put to selected state, an Initial display can be realized when decoding of graphics object representing the normal state 
and the selected state of each button has been complete. In view of this, In the present embodiment, the button-state 
so sets are disposed in the order of "normal state^selected state->active state" as the second row of FIG. 19 shows. 
Accorxfing to this disposition of button-state sets, Initial display can be realized even when the reading and decoding of 
ODSs constituting active state has not yet been complete, and ft becomes also possible to shorten a time period between 
the reading start of a Display Set and completion of an Initial display. 

[0110] Next, the order In which the ODSs shown In FIGs. 16 and 17 should be disposed is explained. FIG.21 is a 
55 diagram Illustrating the order of ODSs In a Display Set In this drawing, ODSs for Normal state is composed of 0DS1 1 -1 3, 
ODS21-23, ODS31-33, ODS41-43. ODSs for Selected state is composed of ODS14-16, ODS24-26, ODS34-36, and 
ODS44-46. Finally, ODSs for Active state Is composed of ODS1 7-1 9, ODS27-29, ODS37-39. and ODS47-49. ODS1 1 -1 3 
areforrenderingexpresslonchangeofacharacterasshownln FIG. 17, andthe same thing can be said to the ODS21 -23, 
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the ODS31 -33, and ODS41 -43. Therefore, by disposing these ODSs In the first button-state set, preparation for an Initial 
display can be made even during reading of the Display Set. By the above arrangement, it becomes possible to perform 
an interactive display to which animation is incorporated, without delay. 

[0111] Next, the order of ODSs to be referenced by a plurality of button states (multi-reference) is explained. Multi- 
s reference means that objectjd of one ODS Is specified by two or more sets of normal_stateJnfo, solected_8tatejnfo, 
and activated_stateJnfo. By such multiple-reference, it becomes possible to use a graphics object for rendering the 
normal state of a button, for rendering another button's selected state. This means that It is possible to share the design 
image of one graphics object Such sharing helps reduce the number of ODSs. Here, it Is problematic which button- 
state set an ODS to be multiple-referenced should be made to belong. 
10 [0112] For example, suppose when a normal state of a button and a selected state of another button are drawn by 
one ODS . Then it is problematic whether this ODS belongs to a button-state set corresponding to Normal state, or a 
button -state set corresponding to Selected state. 

[01 13] in principle, this ODS will be disposed only in a button-state set that corresponds to an earliest-appearing state 
among the plurality of states. 

15 [0114] For Instance, when an ODS is multiple-referenced by a normal state and a selected state, the ODS will be 
disposed In a button-state set for Normal state (N-ODSs), not In a button-state set for Selected state (S-ODSs). In a 
different example, If an ODS is multipe-ref erenced by a selected state and an active state, then the ODS will be disposed 
in a button-state set for Selected state (S-ODSs), and not in a button-state set for Active state(A-ODSs) . In this way, a 
multiple-referenced ODS is disposed only in a button-state set corresponding to the earliest appearing state. 

20 [01 1 5] Next, the order of ODSs in S-ODSs is explained. In S-ODSs, which ODS comes first depends on whether the 
default selected button Is staticaDy determined or dynamically determined. A statical fy-determlned default selected button 
is a button specified by a valid vatue (other than 00) set in default_selected_button_number in the ICS. When a valid 
value other than 00 is set as the default^selectedjDUtton_number, and that no ODS representing a default selected 
button does not exist In the N-ODSs, the ODS representing the default selected button is disposed at the beginning of 

25 the S-ODSs. 

[01 1 6] When the defau(t_selected_button_number Indicates a value of 00, then the button to be set in selected state, 
as a default, will dynamically change depending on the state at a reproduction apparatus side. 
[0117] The case where the defautt_selected_button_number Is set to indicate the value 00 includes a case when the 
AV Clip onto which the Display Set has been multiplexed exists at a Joint point of a plurality of reproduction paths. For 
30 example, suppose a case when the preceding reproduction paths are respectively first, second, and third chapters, and 
the Display set at the joint point Is for displaying buttons corresponding to the first, second, and third chapters. In such 
a case, it is not appropriate to predetermine the button to be in selected state as a default, by the default_.ee lected_ 
button_number. 

[01 18] In such a case, It Is ideal to change the button to be In selected state according to which one of the preceding 

35 plurality of reproduction paths has been passed, until reaching this Display Set (e.g. the second-chapter button when 
reaching from the first chapter, the third-chapter button when reaching from the second chapter, and the fourth-chapter 
button when reaching from the third button). In a case where the button to be in selected state changes depending on 
the preceding reproduction path, the defautt_.ee lected_button_number will be setto indicate "invalid" , I.e. the zero value 
is set thereto. Since the button to be In selected state will change, an arrangement of disposing a certain ODS at the 

*o beginning of the button-state set is not performed. 

[0110] FIG. 22 Is a diagram illustrating difference in the order of ODSs in a S-ODSs, between a case when default. 
se!ected_button_number indicates "0", and when it indicates "button B°. In this drawing, the broken line ss1 Indicates 
the order of ODSs In the S-ODSs when default_eelected_button_n umber Indicates the button B, and the broken line 
ss2 indicates the order of ODSs In the S-ODSs when default_selected_button_number indicates 0. As shown In the 

45 representation of this drawing, when defaulLselected_button_number Indicates the button B, the ODSBs indicating the 
selected state of the button B is placed at the beginning of S-ODSs, with the other buttons' ODSs being placed thereafter. 
On the other hand, when default_selected_ button. number indicates 0, the ODSAs Indicating the selected state of the 
button A Is ptaced at the beginning of the S-ODSs . In this way, whether the default_selected_button_.number is valid 
or not affects the order of ODSs within the S-ODSs. 

so [0120] Next, how a Display Set having such ICS and ODS is assigned to a reproduction time axis of an AV Clip is 
described. An Epoch is a period during which memory management continues on the reproduction time axis. Since an 
Epoch is composed of one or more Display Sets, It is an issue how to assign Display Sets to the reproduction time axis 
of the AV Clip. Here, the reproduction time axis of an AV Clip Is used to define decode/reproduction timing of each piece 
of picture data constituting a video stream multiplexed into an AV Clip. In this reproduction time axis, a decode timing 

55 and a reproduction timing are expressed in a time accuracy of OOKHz. DTS and PTS assigned to these ICS and ODS 
in a Display Set, Indicate a timing to realize synchronized control on this reproduction time axis. Synchronized control 
by means of DTS and PTS assigned to ICS and ODS is assigning of Display Set to the reproduction time axis. 
[01 21 ] First, what kind of synchronized control Is performed by means of DTS and PTS assigned to ODS Is described. 
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k DTS indicates a decode start time for a 



an ODS, In a time accuracy of 90KHz. A PTS indicates a decode end 



10122] 'A DtS'indicates T f 
time for an ODS. 

[0123] Decoding of an ODS does not end in an Instant, and takes a certain time to complete. 

[0124] So. as to clarify the.start point/end point, a DTS and a PTS respectively Indicate a decode start time and a 

decode end time, for an ODS. 

[0126] Since the value of a PTS indicates an ending time, it is necessary that the decoding of ODS) has been complete 
before the time shown by the PTS, and that the decompressed graphics object should be obtained in the object buffer 
of a reproduction apparatus by then. 

[0126] Since the decode start time of an arbitrary ODS] belonging to a Display Set "n" is expressed as DTS(DSn 
[ODS]) In a time accuracy of OOKHz, the time obtained by adding a maxlrnum time required for the decoding to this 
decode start time will be the guaranteed decode end time of the ODS] of the Display Set. 

[0127J Assume that the size of ODS] after decompression is SIZE(DSn[ODSj])> and the decode rate of the ODS is 
Rd. Then the maximum time required for decoding will be S1ZE(DSn[ODS]])//Rd. 
[0128] Note that the operator 7/" used here is a division 
in which decimals are raised to the next whole number. 

[0129] This maximum time Is converted Into a time accuracy of 90KHz, and added to the DTS of ODSj. In this way, 
the decode end time (90KHz) to be indicated by the PTS is obtained. 
[0130] The PTS of ODSj belonging to the DSn is expressed as follows. 



so 



25 



PTS (DS [ODSj ]=DTS (DSn [ODSj] )+90, 000* (SIZE (DSn [ODS j] ) )// 
RD) 

[0131] Then between the two CDS (CDSJ , ODSJ+1), the following relation should be satisfied. 



3? 



PTS (DSn [ODSj ] )*DTS (DSn [ODS j+lj ) 



35 



40 



45 



SO 



55 



[0132] Next, the PTS value of an ICS is explained. 

[013?] If Immediately after an Epoch start, the PTS of an' ICS Is set after a value obtained by adding: (1) PTS value 
of ODS whose decode time finishes the last among the ODSs constituting the initial display of the DSn; (2) a time required 
to clear a graphics plane; and (3) a write time required to' write a graphics object obtained by decoding of ODSs, to the 
graphics plane. 

[01 34] On the other hand, if at an Acquisition Point, the PTS of an IDS is set after a value obtained by adding (1 ) and (3). 
[0135] If default_selected^button_number is indicated by an ICS, preparation for an initial display will be ready when 
the decoding of ODSs for rendering the normal State of all the buttons and the decoding of ODSs for rendering the 
selected state of the default button have been complete. The ODSs for rendering the selected state of a plurality of 
buttons presented in an initial display are called "S-ODSs" , and the ODS in the SODSs whose decode time finishes 
the earliest is called "S-ODSsftrsf (in this case, the ODS for rendering the default button). The PTS value of the S- 
ODSsfirst is set as a PTS value of the ODS whose decode time finishes the last, and is used as a reference value of 
the PTS of the ICS. r . V 
[0136] If default_selected_button_n umber is not indicated by ah ICS, It is hot known which button will be in selected 
state. And so, preparation for an initial display is not complete until preparation for rendering the normal state and the 
selected state of alt the buttons gets ready. Of all the S-ODSs for rendering the selected state of the plurality of buttons 
required in the initial display, the ODS whose decode time finishes the last is called °S-ODSsiast tt . The PTS value of 
this S -ODSslast is set as a PTS value of the ODS whose decode time finishes the last, and is used as a reference val ue 
of the PTS of the ICS. 

[0137] Suppose that the decode end'time of the S-ODSsflrst is expressed as PTS(DSn[S-ODSsflrst]). Then the PTS 
(DSn [ICS]) is obtained by adding (2) and (3), to PTS(DSn[S-ODSsfirstJ) 

[0138] Suppose that the wldthwise size of a rectangular area In which drawing is possible, in a graphics plane Is 
expressed as *Vldeo_wldth* , and the lengthwise size thereof is expressed as Video Jieight". Also; suppose that the 
write rate to a graphics plane is 128Mbps. Under these presumptions, the amount of time required to clear a graphics 
plane is expressed as 8N!deo_width*^^^ 

[0139] If this is expressed in a time accuracy 6f 90 KHz, then (2) atime required to clearthe graphics plane is expressed 
as 90,00O(8>ideojwidthVldeoJieight//1 28,000,000): 
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[0140] Also suppose that the total size of the graphics objects specified by all the button Information included in an 
ICS is expressed as ZSIZE(DSn[tCS.BUTTONp]]) > and a write rate to a graphics plane Is 128Mbps. Then the time 
required to write to the graphics plane Is expressed as lSI2E(DSn[ICS.BUTTON[I]])//l 28,000. If this Is expressed In a 
time accuracy of 90 KHz, the time required to clear the graphics plane is expressed as 90,000* (LSIZE(DSn[ICS.BUTTON 

5 p]])//12B,000,000). 

[0141 J Here, ZSIZE(DSn[ICS.BUTTONp]])lndlcates a total size for the first display object of the graphics objects 
representing a button. This £SIZE(DSn[ICS.BUTTON[l]l) yields a different value between a case where the default 
selected button is decided and a case where it dynamically changes. When the default selected button is statically 
decided, XSl2E(DSn[ICS.BLnTONPD) will yield a total size of: a first displayed one of ODSs that represent the selected 
io state of a default selected button; and a first displayed one of ODSs that represent the normal state of the buttons other 
then the default selected button. 

[0142] Next, when the default selected button dynamically changes, it Is not known which button will be a selected 
button. Therefore it Is necessary to assume the case that has the longest writing time. Here, between a graphics object 
representing a first page of the normal state of an arbitrary button x (ODSnl), and a graphics object representing a first 
15 page of the selected state of the button x (ODSsI ), the one that has a larger size (Max(ODSn1 ,ODSs1 )) is considered 
as a graphics object to be displayed first for the button x. 

[0143] The result obtained by eddlnptogetherMax (ODSnl, ODSs 1) for all the buttons will be ZSIZE(DSn[ICS. BUTTON 
BD>. 

[0144] FIG.23A and FIG.23B are diagrams forshowingthe concrete value for ISIZE(DSn[ICS.BUTTON[i]]), in a case 
20 when N-ODSs Include a plurality of ODSs constituting the buttons A-D, and S-ODSs Include a plurality of ODSs consti- 
tuting the buttons A-D. Here, when the defautt_selected_button_number indicates a valid value, LSIZE(DSn[ICS.BUT- 
TON[iH) will be a total size of four ODSs shown by thick frames. "As1° Is a firstly displayed one of a plurality of ODSs 
representing the selected state of the button A. "Bnr. "CM", and "Dnr are respectively the firstly displayed one of a 
plurality of ODSs representing the normal state of the buttons B-D; When these sizes are expressed by "slze()\ then 
25 SSIZE(DSn[ICS;BUTTON[iJ]) wHI be expressed as size(Asi)^ize(Bnt)+8l2e(Cn1)+8ize(Dn1). 

[01 45] On the other hand, when the default_selected_button_number Is 0, the total of: a larger ODS of An 1 and AS1 ; 
a larger ODS of Bn1 and Bs1; a larger ODS of Ch1 and Cs1; and a larger ODS of Dn1 and Ds1, will be ZSIZE(DSn 
. [ICS.BUTTON[i]]). 
[0148] Therefore, 2SIZE(DSn[ICS.BUTTON[l]]) is expressed as follows. 

30 

£SIZE(DSn [ICS. BUTTON [i} ] )« max< ( size (Anl ),( size 

Asl)) 

35 

+max( (size(Bnl) , (size Bsl) )+max ( (sifce(Cnl) , ( size Csl)) 
+max( (size (Dnl) , (size Dsl)) 

40 

[0147] Then PTS (DSn [ICS]) at Immediately after the Epoch Start will be expressed as follows, using the above 
expressions: 

PTS(DSn[ICS] )*PTS(DSn[S-ODSsfirst] > 

45 

+90 , 000* ( 8*video_width*video_Jieight//128 ,000,000) 
+ 90 , 000* ( £SIZE (DSn [ ICS ♦ BUTTON [ i J ] ) 128 , 000 , 000 ) 

50 

[0148] On the other hand, when the default_selected_button_number Is Invalid, It Is only necessary to replace PTS 
(DSn[SODSsflrst]j with PTS(DSn[S-ODSslast]). The concrete expression will be as follows: 



55 
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PTS(DSn[ICS] )*PTS(DSn [S-ODSslast J ) 
+90, 000* (8*video_width*video_height//128, 000,000) 

5. 

+90, 000* (£SIZE(DSn [ICS. BUTTON [i]] )128,000,000) 



pi 49] FIQ.24 shows one example of realizing synchronized display by setting PTS and DTS in the above way. In this 
io diagram, assumption is made such that a button is displayed at a display timing of arbitrary picture data "py1 * which is 
In the motion picture In this drawing, in this case, the PTS value of the ICS should be set so as to coincide with the 
display timing of this picture data. 

[0160] Decoding of the ODS whose decode time finishes the last, among the ODSs constituting the Initial display of 
the DSn, should be complete by the time obtained by subtracting, from the PTS of the ICS, the screen-clearing period 
is cd1 and the graphics-object transfer period tdl . Therefore the PTS value of the ODS should be set at the timing (*i ) 
shown in this drawing. Furthermore, the decoding of the ODS takes the period dd1 , and so the OTS value of this ODS 
should be set at the ddl period earlier than this PTS. 

[0151] In FIG. 24, there is only one ODS to be overiayed with the motion picture, which is a simplified case. If the 
initial display of the Interactive display to be overtayed with the motion picture Is realized by a plurality of ODSs. PTS 

20 and DTS of the ICS, and PTS and DTS of ODS should be set as In FIG.25. 

[01 52] FIG.25 is a diagram showing how to set DTS and PTS, in a case when a plurality of ODSs compose the initial 
display of the interactive display, and the default selected button Is statically decided. If the decoding of the ODS whose 
decoding takes the longest in S-ODSsflrst (the ODSs for realizing the Initial display) finishes whjen the time dd1 has 
passed In the drawing, then the PTS of this S-ODSsfirst (DSn [SODSsfirst]) is set to indicate the time at which the 

£5 period ddl has passed. 

[01 53] Furthermore , It Is necessary to perform screen clearing and transferring of decoded graphics objects, for realizing 
initial display. Therefore, the PTS of the ICS (DSn[ICS]) should be set after the time obtained by adding, to the value of 
this PTS(DSn[S-ODSsflret]), a. period required to perform screen clearing (90,000* (8*video_wkith*videoJi eight// 
128,000,000)), and transferring time of decoded graphics object (90,000*(ZSIZE(DSn[iCS.BLnTON[l]])1 28,000,000)). 

30 [0154] FIG.26 is a diagram showing how to set DTS and PTS, in a case when a plurality of ODSs compose the Initial 
display of the interactive display, and the default selected button is not decided. If the decortng of the S-ODSslast, 
whose decoding takes the longest in SODSs for realizing the initial Display, finishes when the time dd2 has passed In 
the drawing, then the PTS of this S-ODSslast (DSn[S-ODSslast]) Is set to indicate the time at which the period dd2 has 
passed. 

36 [0155] Furthermore, so as to realize an Initial display, It is necessary to perform screen clearing, and transferring of 
decoded graphics object Therefore the PTS(DSn[ICSJ) of the ICS should be set after the time obtained by adding, to 
the value of this PTS(PSn[S-ODSslastJ), a period required to perform the screen cIearing(90.000*(8*video_wldth # vWeo_ 
height//1 28,000,000) and transferring time of decoded graphics object (90 ,000*(ZSIZE(DSnpCS. BUTTON p]]) 
128,000.000)). 

<o [0156] In a DVD, a period during which an interactive control is valid corresponds to a period of a VOBU, which 
functions as a GOP of the video stream. However, in a BD-ROM, such a valid period can be set arbitrarily by means of 
PTS and DTS in ICS Included In an Epoch. Therefore the interactive control by means of a BD-ROM Is not In dependence 
relation with a GOP. 

[01 57] Note that a synchronized control by means of a PTS of an ICS is not limited to perform control so as to display 
45 a button at a certain timing on a reproduction time axis, and also includes performing of control so as to enable display 
of a Popup menu during a certain period on a reproduction time axis. A Popup menu is a menu that will be popped up 
on a screen, by a press of a menu key provided for the remote controller 400, and the synchronized control by means 
of PTS of ICS also Include enabling of display of such a Popup menu at a display timing of certain picture data in an AV 
Clip. The ODSs constituting a Popup menu are decoded and a graphics object obtained by the decoding are written to 
so a graphics plane, just as the ODSs constituting a button. Unless the writing to a graphics plane is not complete, it Is not 
possible to respond to a menu call by a user. In view of this, a time at which the Popup display becomes possible is 
indicated by the PTS of ICS, in performing synchronized display of a Popup menu. 

[01 68] The data structure of a Display Set (ICS, PDS.ODS), described so far, is an instance in a class structural body 
written in a programming language. A producer who performs authoring is able to obtain the structures on a BD-ROM, 
55 by describing this class structural body. 

[01 59] Next, an embodiment of a reproduction apparatus according to the present Invention is explained. FIG. 27 is 
a diagram showing the Internal structure of a reproduction apparatus according to the present Invention. The reproduction 
apparatus according to the present Invention Is produced industrially based on the Interior shown in this drawing. The 
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reproduction apparatus of the present Invention Is mainly composed of three parts: a system LSI, a drive apparatus, 
and a micro system. The Industrial production is pursued by Implementing these parts to the cabinet and to the substrate 
of the reproduction apparatus. The system LSI Is an Integrated circuit onto which varieties of processing units, having 
functions of the reproduction apparatus, are Integrated. The reproduction apparatus produced In such a way Is comprised 

* of: a BD drive r, a track buffer 2, a PI D fitter 3, a transport buffers 4a, b, and c, a peripheral circuit 4d ( a video decoder 
5, a video plane 6, an audio decoder 7, a graphics plane 8, a GLUT unit 9, an addition device 10, a graphics decoder 
1 2, a coded data buffer 1 3, a peripheral circuit 13a, a stream graphics processor 1 4, an object buffer 1 5, a composition 
buffer 16, a graphics controller 17, a UO controller 18, a player register group 19, and a control unit 20. 
[01801 The BD-ROM drive 1 executes access to the BD-ROM by performing loading/reading/ejecting for a BD-ROM. 

io [01 81 J The track buffer 2 is a FIFO memory, and stores TS packets read from the BD-ROM, on aflrsMn first- out basis. 
[0162] The PID filter 3 performs filtering to a plurality of TS packets outputted from the track buffer 2. The filtering by 
the PID filter 3 Is to write only TS packets having a desired PID, to the transport buffers 4a, b, and c, and does not require 
buffering. Therefore the TS packets Inputted to the PID filter 3 will be written to the transport buffers 4a, b, and c, without 
time-delay. 

is [0163] The transport buffers 4a, b, and c are respectively a memory for storing TS packets outputted from the PID 
filter 3, on a fi ret-In, first-out basis. 

[0164] The peripheral circuit 4d Is a wire logic that performs processing to convert TS packets read from the transport 
buffer 4a, Into functional segments. The functional segments obtained by the conversion are stored In the coded data 
buffer 13. 

20 [0165] The video decoder 5 decodes a plurality of TS packets outputted from the PID filter 3 to obtain decompressed 
pictures, end write them to the video plane 6. 
[01 66] The video plane 6 is a plane for motion pictures. 

p)167] The audio decoder 7 decodes the TS packets outputted form the PID filter 3 to obtain decompressed audio 
data, and outputs the decompressed audio data. 
25 [0188] The graphics plane 8 Is a memory having an area corresponding to one screen, and is able to store decom- 
pressed graphics for one screen. 

[0169] The CLUT unit 9 converts Index colors of the decompressed graphics stored In the graphics plane 8, based 
on the Y, Cr, Cb values shown by the PDS. 

[01 70] The addition device 1 0 multiplies the decompressed graphics resulted from color conversion at the CLUT unit 

ao g, with a T value (transmission rate) shown by the PDS, and adds the result and the decompressed picture data stored 
in the video plane 6, pixel by pixel, to obtain an overlayed Image, and outputs the overiayed Image. 
[0171] The graphics decoder 12 decodes a graphics stream, to obtain decompressed graphics, and writes this de- 
compressed graphics to the graphics plane 8, as a graphics object By decoding of the graphics stream,. subtitles and 
menus will appear on a screen. This graphics decoder 12 Is comprised of a coded data buffer 13, a peripheral circuit 

35 13a, a stream graphics processor 14, an object buffer 15, a composition buffer 16, and a graphics controller 17. 

[0172] The coded data buffer 13 Is a buffer in which the functional segments are stored together with DTS and PTS. 
Such functional segments result from removing a TS packet header, and a PES packet header from each TS packet In 
a transport stream stored in the transport buffer 4a, and then disposing the payloads sequentially. Among the removed 
TS packet header and the PES packet header, PTS/DTS are stored In association with a corresponding PES packet. 

40 [0173] The peripheral circuit 13a Is a wire logic that realizes: transferring between the coded data buffer 13 and the 
stream graphics processor 14; and transferring between the coded data buffer 13 and the composition buffer 16. In such 
transferring processing, when It reaches a time shown by the DTS of an ODS, the ODS is transferred from the coded 
data buffer 13 to the stream graphics processor 14. In addition, when it reaches the time shown by the DTS of an ICS 
and a PDS, the ICS and the PDS are transferred to the composition buffer 16. 

45 [0174] The stream graphics processor 14 decodes an ODS, and writes the decompressed graphics composed of 
Index colors resulting from decoding, to the object buffer 1 5, as a graphics object. The decoding by the stream graphics 
processor 14 starts at the time of a DTS associated with the ODS. and ends at the time of a PTS associated with the 
ODS. Trie decode rate "Rd" for the aforementioned graphics object corresponds to an output rate of this stream graphics 
processor 14. 

so [0175] The graphics object obtained from the decoding of the stream graphics processor 14 to stored In the object 
buffer 15. FIG.28 Is a diagram showing a storage content of r-e object buffer 15, In contrast to the graphics plane 8. 
This storage content assumes a case where the ODSs In the example shown by FIGs, 1 6 and 1 7 are written to the object 
buffer 15. In the example of RGs.16 and 1 7, four-button animation is realized by 36 ODSs (ODS1 1 -49). In this example, 
the ODSs representing all the frames of this animation are stored In the object buffer 15. In contrast, a display position 

55 of each of the ODSs stored in the object buffer 1 6 is defined In the graphics plane 8. This display position Is defined by 
button.horlzontal position and button^vertlcal position of each piece of button Information. The animation is realized by 
transferring the ODSs from the object buffer 15, frame by frame, so as to write the ODSs to the corresponding display 
positions of the graphics plane 8. 
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[0176) The composition buffer 1 6 Is a memory in which ICS and PDS are disposed. 

[0i77J The graphics controller 17 decodes the ICS disposed In the composition buffer 16, and performs control ac- 
cording to the ICS. The execution timing of this control is based on the value of PTS assigned to the ICS. On.e of the 
most important functions of this graphics controller 1 7 Is writing processing at Initial display and at update of an Interactive 

5 display. The following explains writing processing of the graphics controller 1 7 at Initial display and at update, by referring 
to FIG.29. FIG. 29 is a diagram showing the processing performed by the graphics controller 17 at an Initial display. As 
shown In this drawing, the graphics controller 1 7 performs control to write the ODSs belonging to the S-ODSs of the 
button A. to a display position defined by the butte* JwrizontaLposttion and the button^verticaLposltion of the button 
A's button information, and to write the ODSs belonging to the N-ODSs of the buttons B, C, and D, respectively to cfisplay 

10 positions defined by the buttonJiorizontaLposltlon and the buttqn_verticaLposit1on of the button Information of the 
buttons B, C, and D (The arrows w1 , w2, w3, and w4 In the drawing symbolically show the above-described writing). By 
the writing, the Initial display of FIG.20 is realized. Please note here that not all the ODSs are not necessary for ah Initial 
display of an Interactive display. The initial display is realized when the ODSs belonging to the S-ODSs of the default 
selected button and the ODSs belonging to the N-ODSs of the other buttons have been ready on the object buffer 15. 

is That Is, the graphics controller 17 can start writing for an Initial display, If decoding has been complete for the ODSs 
belonging to the S-ODSs of the default selected button, and for the ODSs belonging to the N-ODSs of the other buttons. 
[0178] FIG. 30 is a diagram showing processing of the graphics controller 17 at an update of an interactive display 
according to 1 stUser Action (Move Right). As shown in this drawing, the graphics controller 17 performs control to write 
the ODSs belonging to the S-ODSs of the button B, to a display position defined by the button^horizontaLposltion and 

20 the button_verticai_position of the button B's button information, and to write the ODSs belonging to the N-ODSs of the 
button A, to a display position defined by the button_horizontal_position and the button_vertical _j>osition of the button 
A's button information (The arrows wS, w6, w7, and w8 symbolically show the writing). By this writing, the state transition 
as shown in FIG.20 is realized. The buttons C and D stay in normal state, just as In the initial display of the interactive 
display, but the writing for these buttons to the graphics plane 8 is continued so as to continue the animation. 

25 [0179] FIGs. 31 and 32 respectively show the processing of the graphics controller 17, in each cases where the 
IstUserAction is MoyeDown and Activated. At anlnteractive-display update, S-ODSs and A-ODSs for the buttons other 
than the default selected button are involved, and so all the ODSs are required to exist in the object buffer 1 5. 
[0180] The UP controller 1 B detects a user operation directed to the remote controller and to the front panel of the 
reproduction apparatus, and outputs information corresponding to the user operation (hereinafter "UO(user operation)"), 

30 to the control unit 20. 

[01 81] The player register group 1 9 Is a register embedded in the control unit 20, and is comprised of 32 player status 
registers and 32 general purpose registers. The meaning of the set value of the player status registers (PSR) Is described 
below, in the following, the notation as "PSR(x)" represents a set value of the xth player status register. 
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PSR(0) : 


Reserved 




PSR(1): 


stream no. of audio stream to be decoded 




PSR{2) : 


stream no. of sub-picture stream to be decoded 




PSR(3) : 


no. representing angle setting by a user 




PSR(4) : 


title no. currently reproduced 
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PSR(6) : 


chapter no. currently reproduced 




PSR(6) : 


PL no. currently reproduced 




PSR(7): 


Playftem no. currently reproduced 




PSR(8) 


rtime information indicating current reproduction point 




PSR(9) : 


counted value at navigation timer 
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PSR(10): 


button no. currently In selected state 




PSR (11M12): 


Reserved 




PSR(13) : 


parental level setting by a user 




PSR(14): 


video reproduction setting of reproduction apparatus 




PSR(15) : 


audio reproduction setting of reproduction apparatus 


SO 


PSR(16) : 


language code representing audio setting of reproduction apparatus 




PSR(17) : 


language code representing sub-title setting of reproduction apparatus 




PSR(1B): 


language setting for menu rendering 




PSR(19)-(83): 


Reserved 



ss [0182] The PSR(8) Is updated every time each piece of picture data of a AV Clp is displayed. In other words, when . 
the reproduction apparatus displays a new piece of picture data, the PSR(8) is updated to indicate the value shown by 
the display start time (presentation time) of the new piece of picture data. By referring to this PSR(8), it is possible to 
know the current reproduction point. 



17 . 

v DOCK* <EP 1B68190A2_L> 



EP 1 868 190 A2 



[01 83) The control unit 20 performs Integration control through bi-directional communication with the graphics decoder 
12. The communication from the control unit 20 to the graphics decoder 12 Is to output an UO received at the UO 
controller 18 to the graphics decoder 12. The communication from the graphics decoder 12 to the control unit 20 Is to 
output a button command included in an ICS to the control unit 20. 
9 [01 841 In the reproduction apparatus constituted as above, each constituting element performs decoding processing 
using pipelining. 

[0185] FIG, 33 Is a timing chart showing the pipelining performed by the reproduction apparatus. The fourth row rep- 
resents a Display Set In a BD-ROM, and the third row represents reading periods that are respectively for reading the 
ICS, PDS, and ODS, to the coded data buffer 13. The second row represents decoding periods for ODSs, performed 

to by the stream graphics processor 14. The first row represents processing periods by the graphics controller 17. The 
decoding start time for each ODS is shown by the DTS1 1 , DTS 1 2, and DTS1 3 In the drawing. The storing of ODS (N- 
ODSs [ODS1 ]) (being the first ODS among the N ODSe) to the coded data buffer 1 3, finishes by DTS1 1 , and the storing 
of ODS(N-ODSs[ODSnJ) (being the last ODS among the N-ODSs) to the coded data buffer 13, finishes by DTS 12. In 
this way, each ODS will have been read to the coded data buffer 13 by the time shown by Its own DTS. 

is [0188] On the other hand, the decode end time for each ODS Is shown by PTS11, PTS12, PTS13, In the drawing. 
Decoding of N-ODSs(ODSI) performed by the stream graphics processor 14 finishes by PTS1 1 , and decoding of N- 
ODSs(ODSn) finishes by PTS12, In the above way, each ODS Is read to the coded data buffer 13 by the time shown 
by the DTS of the ODS. and the ODS read to the coded data buffer 1 3 Is decoded and written to the object buffer 1 5 by 
the time shown by the PTS of the ODS. The stream graphics processor 1 4 performs the described series of processing 

20 using pipelining. 

[0187] When the default selected button Is statically decided, the time at which all the graphics objects for an Initial 
display of an interactive display are ready Is when the decoding of a first ODS of the button-state set corresponding to 
the normal state and of a first ODS of the button-state 6et corresponding to the selected state Is complete. In this diagram, 
at the time shown by the PTSi 3, all the graphics objects necessary for the initial display of the Interactive display are ready. 

25 [0188] In the drawing, the period cd1 In the first row represents a period required to clear the graphics plane 8 by the 
graphics controller 1 7. In addition, the period td1 Is a period required to write, to the graphics plane 8, graphics objects 
that correspond to the first page of the Interactive display, among those obtained in the object buffer 15. The writing 
destination in the graphics plane 8 Is shown by button_horizontal ^position and button_vertlcal_posttlon In the ICS. In 
other words, the decompressed graphics constituting the Interactive display is obtained to the graphics plane 8, at a 

30 time calculated by adding the screen clearing period "cdl D and the write time required to write the graphics object obtained 
by decoding "td1\ to the PTS13 for ODS. An overlayed Image can be obtained by having the CLUT unit 9 to perform 
the color conversion for the aforementioned decompressed graphics, and having the addition device 10 to perform 
combining the result with the decompressed pictures stored in the video plane 6. 

[0189] In contrast to the case where an Initial display Is performed by decoding all the ODS Included In a Display Set, 
35 the initial display In the present embodiment Is performed earlier by the period hyl in the drawing, because the initial 
display Is performed before decoding completion for the button-state set corresponding to the selected sate and the 
button-state set corresponding to the active state. 

[0190] Note that in this drawing, there are several sets of ODS1 -ODSn. However these sets respectively belong to 
N-ODSs, S-ODSs, and A-ODSs, and so the same ODS1s are different in content from each other. This also applies to 
the similar drawings in the present Invention. 

[0191] Even while the graphics decoder 1 2 is performing clearing of, and writing to the graphics plane 8, the stream 
graphics processor 14 is continuously decoding the remaining ODSs (I.e. decoding period for ODSn in the second row, 
decoding period for ODS1 , and decoding period for ODSn). According to this, decoding of the remaining ODSs will finish 
early. This leads to early preparation for updating the Interactive display, and so It becomes possible to respond to a 

45 user operation regarding an interactive display update by means of the remaining ODSs, without delay. The pipelining 
as above enables prompt execution of both of an Initial display and an update of an Interactive display. 
[0192] FIG. 33 assumes a case where the default selected button is statically decided, whereas FIG.34 Is a timing 
chart showing pipelining performed by the reproduction apparatus In a case where the default selected button dynamically 
changes. When the default selected button dynamically changes, the graphics objects necessary for an Initial display 

so will be ready when all the ODSs belonging to the button-state sets respectively corresponding to the N-ODSs and the 
S-ODSs are decoded, and corresponding graphics objects are obtained in the graphics plane 8. In contrast to the case 
where It Is necessary to decode all the ODSs In a display set so as to perform an Initial display, the Initial display In the 
present embodiment Is made possible before decoding completion of thebutton-state set corresponding to the active 
state. Therefore the Initial display execution is performed earlier by the period hy2 in the drawing. 

55 [01 93] Next, how to Implement the control unit 20 and the graphics decoder 1 2 is explained. The control unit 20 creates 
a program for performing processing shown in FIGs . 35 and 36, which Is implementable by a general CPU. As follows, 
the processing performed by the control unit 20 Is explained with reference to FIGs.35 and 36. 
[01 94] FIG.35 Is a flowchart showing the execution procedure for a LInkPL function, performed by the control unit 20. 
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In decoding of the commands inducing the LlnkPL function, the control unit 20 follows the flowchart of this drawing. 
[01 96] Here, assumption Is made that a processing-target Playltem In the flowchart Is called 'Ply", and a processing- 
target ACCESS UNIT Is called "ACCESS UNITv". In this flowchart, current PL Information (.mpls) Indicated by an 
argument of the LlnkPL Is read (Step S1), and the first PI information In the current PL Information Is set as Ply (Step 

5 S2). then the Clip Inf ormatlon specified by the CI1pJntormatlon_flle_name of the Ply Is read (Step S3). 

[0198] Once the Clip Information is read, ln_J1me of the Ply Is converted to an address using EP^map of the current 
Clip Information (Step S4), Then the ACCESS UNIT specified by this address Is set as the ACCESS UNITv (Step S5). 
oirUime of the Ply is converted to an address using EP_map of the current Clip Information (Step SB). Then the ACCESS 
UNIT specified by this address is set as ACCESS UNITw (Step S7). 

10 [0197] In this way, once the ACCESS UNITv.w are decided, an instruction Is given to the BD drive to read from the 
ACCESS UNITv to the ACCES UNITw (Step S8), and an instruction for decodlng/outputtlng of Ply from the ln_time to 
the Out_time, Is given to the video decoder 6, the audio decoder 7, and the graphics decoder 1 2 (Step S9). 
[0198] Step S1 1 Is for performing ending judgment for the flowchart. Specifically, It is judged whether the Ply has 
reached the last PI. If the Step S11 results In Yes, the flowchart is ended. Otherwise, the next Playltem is set as Ply 

15 (Step SI 2), and the operation returns to Step S3. Hereinafter, the processing of Step S1 -Step Si 0 is repeated until Step 
S1 1 results in Yes. 

[0199] Step S10 is a step for loading functional segments to the coded data buffer 13, in response to the reading of 
ACCESS UNIT. 

[0200] FIG.361saflowchartshowingtheprocedureforload 
20 •SegmentK" represents a variable corresponding to each of Segment (ICS.ODS.PDS) read together with the ACCESS 
UNIT. An Ignore flag Is used to switch between ignoring and loading of SegmentK. This flowchart has a loop structure 
in which processing of Steps S21-S24, and Steps S27-S35 is repeatedly performed for all the SegmentK, when the 
Ignore flag has been set as "0", and has been initialized (Step S25, S26). 

[0201] Step S21 is for Judging whether a SegmentK Is an ICS. If the SegmentK is an ICS, judgments of Step S27 and 
25 step S28 are performed. 

[0202] Step S27 is for judging whether the Segment_Type of the ICS is an Acquisition Point or not If the SegmentK 
turns out to be an Acquisition Point, the operation moves onto Step S28. Conversely, If the SegmentK turns out to be 
either an Epoch Start or a Normal Case, the operation moves onto Step S33. 

[0203] Step S28 Is for judging In which buffer (among the coded data buffer 13, the stream graphics processor 14, 
30 the object buffer 15, and the composition buffer 16), the preceding DS is found within the graphics decoder 12, and Is 
performed when Step S27 has resulted In Yes. When a DS Is not found in the graphics decoder 12, it means that a 
random access has been performed. In this case, display should start from the DS being an Acquisition Point. Therefore 
the operation moves onto Step S30 (Step S28:No). 

[0204] When the preceding DS Is found In the graphics decoder 1 2 (Step S2B: Yes), the ignore flag Is set as "1 " (Step 
as $29), and the operation moves onto Step S31 . 

[0205] Step S31 is forjudging whether the command^updatejflag is set as 1 or not If 1 (Step S31:Yes), only the 

button command in the button Information is loaded to the coded data buffer 13, and the others are ignored (Step S32). 

If 0, the operation moves onto Step S22. In this way, ICSs indicating an Acquisition Point will be ignored (Step S24). 

[0208] If the ignore flag is set as 1 , Step S22 will result In No, and as a result, all the functional segments belonging 
40 to an Acquisition-point DS are Ignored, 

[0307] Step S33 is for judging whether the SegmentType in an ICS indicates a Normal Case or not When the 

SegmentK is an Epoch Start, the ignore flag is set as 0 at Step S30. 

[0208] When the ignore flag is 0 (Step S22:Yes), the SegmentK Is loaded to the coded data buffer 13 (Step S23). 
[0209] When the SegmentK Is a Normal Case, the operation moves onto Step S34. Step S34 Is the same as Step 

45 S28, In content, and is for Judging whether the preceding DS is found In the graphics decoder 1 2. If the Judgment is In 
the affirmative, the ignore flag Is set as "(T (Step S30). If the judgment is in the negative; the Ignore flag Is set as "1 *, 
because it is inherently Impossible to obtain sufficient number of functional segments for constituting an interactive 
display (Step S35). According to the above flag setting, when the preceding DS cannot be found in the graphics decoder 
1 2, the functional segments constituting the Normal Case will be Ignored. 

so [0210] Next, the following explains how reading of a DS is performed In a case where multiplexing involving DS is 
performed as in FJG.37. In the example of FIQ.37, three DSs have been multiplexed with a motion picture made of a 
plurality ol pictures. In the first DS (DS1 ) among the three DSs, Segment_Type indicates an Epoch_Start, Command. 
update_flag Is set as 0, and a button command of UnkPL (PL#5) is Included. 

[0211] DSIOtsadupllcate of DS1 , and DS10*sSeojnent_Type indicates an Acquisition Point, andCommand_update — 
55 flag is set as 0, and a button command of UnkPL(PL# 5) Is included therein. 

[0212] DS20 is an Inherit of DS1 , and 0520*8 Segrnent_Type indicates an Acquisition Point The only difference with 
DS1 Is the button command (L1hkPL(PL#1 0)). So as to indicate existence of a difference, Command_upofete Jlag Is set 
as 1. 
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[0213] In en AV Clip In which the above-described three DSs have been multiplexed with a motion picture, suppose 
that random access is performed at the picture data pt10. In this case, the nearest OS10 to this random-access point 
will be a target of the flowchart processing of FIG.36. At Step S27, segmerrtjype Is judged to be an Acquisition Point, 
but the preceding DS cannot be found in the graphics decoder 1 2. Therefore the ignore flag is set as 0, and this D51 0 

5 is loaded to the coded data buffer 13 In the reproduction apparatus, as shown In FIG . 36 . On the other hand, when the 
random-access point exists after the point where the present Display Set 1 0 exists (the broken iine hetl In FIG. 37), the 
Display Set 20 (hst2 In FIG.38) that follows the Display Set 10 Is read to the coded data buffer 13. 

[0214] FIG .40 shows how the loading of DS1 , D310, and DS20 is performed when a normal reproduction fs performed 
as in FIG.39. Among the three DSs, DS1 whose segment.type in ICS is an Epoch Start is loaded to the coded data 

w buffer 13, as it is (Step S23). However, DS10 whose segment_type in ICS is an Acquisition Point, has the ignore flag 
set as 1 (Step S20), and so the functional segments constituting DS10 are Ignored and not loaded to the coded data 
buffer 13 (Step S24). With regard to DS20, Segment_type of ICS Indicates an Acquisition Point, but command_update_ 
flag is set as 1. Therefore, Step S31 results in Yes, and so only the button command is loaded. As a result, as for the 
DS of the coded data buffer 1 3, only the button command in the ICS Is replaced with this loaded button command (Step 

15 S32) . Here, since the Ignore flag still indicates 1 , other elements than the button command are Ignored and not loaded. 
[0215] Although having the same display content as the DS1 , the button command has been replaced from the LlnkPL 
(#5) of the DS1 to the LlnkPL(#1 0) of DS20, on arriving at the DS20. Such replacement facilitates control to change the 
content of the button command In course of the reproduction. Next, the processing procedure of the graphics controller 
17 Is described. FIG.41 Is a flowchart in which processing corresponding to the main routine In the processing of the 

20 graphics controller 1 7 Is described. In this flowchart, the three kinds of processing are repeatedly performed: time stamp 
synchronized processing (Step S35); animation display processing (Step S36); and UO processing (Step S37). 
[0216] FIG. 42 is a flowchart showing the processing procedure for synchronized control performed by means of a 
time stamp. In this flowchart, It is judged whether any of the phenomena of Step S41 , S43-Step S47 holds, tf any of the 
phenomena holds, a subroutine Is formed In which a corresponding operation is performed, and then the operation 

6 returns to the main routine. 

[0217] Step S41 is for judging whether the current reproduction time is any one of a time shown by the PTS of the S- 
ODSsflrst, and a time shown by the PTS of the S-ODSslast If the Judgment is In the affirmative, a period ct Is calculated 
at Step S42. The period a Is a period obtained by adding (2) a time required to clear a graphics plane, and (3) a time 
required to write a graphics object obtained by decoding an ODS to the graphics plane. 

3o [02ia] At Step S42, the graphics controller 1 7 refers to Segment_Type of ICS, and if the Segment_Type Indicates an 
Epoch Start, a Is set as (2) plane clearing time + (3) plane writing time, rf ft indicates an Acquisition Point, a is set as (3) 
plane writing time. To calculate the plane writing time (3), the calculation of Flg.23A is used when the default_selected_ 
button_number indicates a valid value. On the other hand, when the defauft_selectedJ?utton_number indicates 0, the 
calculation of FIG.23B Is used to calculate the plane writing time (3) . After the period a is calculated In the above way, 

35 the operation returns to loop processing. 

[0219] Step S43 is for judging whether the current reproduction time Is a time indicated by the PTS-a of ICS. If the 
judgment Is in the affirmative, writing processing to the graphics plane B Is performed (Step S51), and the operation 
returns to the main routine. 

[0220] Step S46 le forjudging whether the current reproduction time Is PTS of ICS. If the judgment is in the affirmative, 
^o outputting the storage content of the graphics piano 8 is started. The outputting destination of this storage content is the 
GLUT unit 9. After being subjected to the color conversion at the CLUT unit 9, the interactive display will be overiayed 
with the storage content of the video plane 6. By doing so, an initial display is performed (Step S52). Then the variable 
"animation (p) (p»T, 2, 3, ...n) Is set as 0 (Step S53), and the operation returns to the main routine. Here, the 
variable "animation (p)* Is a global variable Indicating the ordinal position of the current frame in the sequence of frames, 
45 which will stay valid throughout a plurality of flowcharts. At Step S53, the button (p) of all the buttons will be set as 0. 
[0221] Step S46 and Step S47 are for judging whether the current reproduction time has reached the time Information 
described In ICS. 

[0222] Step S46 is for judging whether the current reproduction time Is a time. shown by selectlon_TlmeOut_PTS. If 
the judgment Is in the affirmative, processing to activate a button indicated by the default_actrvated_button„number Is 

so performed, and the operation returns to the main routine (Step S54). 

[0223] Step S47 is forjudging whether the current reproduction time Is a Composition jnmeOut_PTS. If the Judgment 
is in the affirmative, screen clearing Is performed and the operation returns to the main routine (Step S66). In the above- 
described synchronized processing by means of a time stamp, Step S51 and for Step S54 are respectively created as 
a subroutine. As follows, the processing performed at the subroutine of Step S61 is explained with reference to FIG.43. 

55 [0224] FIG. 43 Is a flowchart showing a processing procedure for writing an Initial display of a menu to the graphics 
plane 8. Step S64 is for judging whether Segmentjype of ICS Indicates an Epoch Start. If the judgment is in the 
affirmative, the graphics plane 8 is cleared at Step S85, and the processing of Step S66-Step S73 is performed. The 
time required to clear the graphics plane 8 corresponds to a period cd1 In FIG.25 and In FIGJ26. If the judgment is in 
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the negative, Step S65 is skipped and the processing of Step S66-Step S73 Is performed. 

[0225] Step S68-Step S73 form toop processing that is repeated for each piece of button information in an ICS (Step 
S66, Step S67). in this loop processing, a piece of button information that is the processing target is called "button 
information (p)". 

[0226] Step S67 is for Judging whether default_selectedlbutton_n umber Indicates a valid number. Step S68 is for 
judging whether button Jnfo(p) corresponds to the default selected button specified by the defautt_setected_button_ 
number: 

[0227] If the buttonjnf o (p) does not correspond to the default selected button, the graphics object of the stait_object_ 
id_normal indicated by the normaLstateJnfo of the button_lnfo(p) is found from the object buffer 15, and set as a 
graphics object(p) (Step S69). 

[0228] If the button Jnfo(p) does correspond to the default selected button, the graphics object of the starLobjectJoL 
selected Is found from the object buffer 15 (Step 570), end the button (p) is set as a current button (Step S71). The 
current button is a button set in selected state In the interactive display currently displayed, and the reproduction apparatus 
stores the identifier of this current button as PSR(1 0). 

[0229] After being identified by going through Step S69 - Step S70, the graphics object (p) is written to a graphics 
plane 8, at a position shown by the button Jiorizontal .position and buttbn_vertical_position of the button Jnfo(p) (Step 
S72). By repeating this processing to each piece of button information of an ICS, the first graphics object will be written 
to the graphics plane 8. The time required to complete this processing for the graphics objects, which are among those 
on the graphics plane 15 and are necessary for an Initial display, corresponds to the time tdl shown In FIG.25and FfG.26. 
[0230] When the def ault_se lected_butto n_number Indicates 0, and the default selected button dynamically changes, 
Step S67 wlil be No, and at Step S73, it Is Judged whether the buttonjnfo(p) corresponds to the current button. If the 
judgment is in the affirmative, the operation moves onto Step S70. If the Judgment is in the negative, the operation moves 
onto Step S69. 

[0231] Next, a processing procedure for a subroutine of Step S54 is explained with reference to FIG.44. 

[0232] FIG.44 is a flowchart showing a processing procedure how to auto-activate a default selected button. First, 

whether the o^fault_activated_button_nurnber is 00 or FF, is judged (Step S75). If the def ault_activatedJ>utton_n umber 

is "00", the operation returns to the main routine without performing any processing. If the default_activated_button_ 

number is "FP, the current button I is changed to active state (Step S77). Then animation (I), which is a variable 

corresponding to the current button l, is set as 0, and the operation returns to the main routine (Step S78). 

[0233] If the defaulLactivatedJt>utton_nurnber is neither 00 or FF, the button indicated by the defaulCactivated-- 

button_number is set as a current button (Step S76), and the current button l is changed to active state (Step S77). and 

the animation (I), which is a variable correpsonding to the current button I, is set as 0, and the operation returns to the 

main routine (Stpe S78). 

[0234] According to the above processing, after a predetermined time, the button In selected state will be changed to 
active state. 

[0235] Next, the animation In a menu (Step S36) is described. FIG.45 Is a flowchart showing a processing procedure 
for an animation display. 

[0236] Here, the initial display is realized by writing graphics objects specified by stait_object_id_normal of normal, 
state Jnfo, and start_objectjd_selected of selected_stateJnfo, in each buttonjnfo, to the graphics plane 8. The ani- 
mation is processing to overwrite this graphics plane 8 with an arbitrary frame (i.e. a graphics object corresponding to 
a oth frame) in each button, every time the loop operation of Step S35-Step S37 finishes one loop. Specifically, this 
process of updating is realized by writing graphics objects specified by normaLstateJnfo and selected_stateJnfo, in 
buttonjnfo, one by one to the graphics plane 8 and returning to the main routine. Here, m cf Is a variable for specifying 
each graphics objects specified by normaLstateJnfo and setected_stateJnfo of buttonjnfo of each piece of button 
information. 

[0237] The processing for realizing this animation display is explained with reference to FIG.45. For brevity, this 
flowchart is created based on the assumption that repeaLnormalJIag and repeaLselectedJlag are set to indicate that 
the repetition is necessary. 

[0238] Step S80 is for judging whether an Initial display has been complete. If an initial display has not been complete, 
the operation makes a return, without performing any processing. If an initial display has been complete, Step S81 -Step 
S93 is designed to structure loop processing In which the processing of steps S81 -Step S93 is repeated for each button, 
info In an ICS (Step S81 , Step S82). 

[0239] Step S83 sets animation (p) (the variable corresponding to the button Jnfo (p)), to a variable q. In this way, the 
variable o; win indicate the ordinal position of the current frame in the sequence of frames, which corresponds to the 
buttonJnfo(p). 

[0240] Step S84 Is for judgl n g wh ether button Jnfo(p) corresponds to a button currently in selected state (current button). 
[0241 ] If the buttonJnfo(py corresponds to a different button from the current button, an identifier, obtained by adding 
the variable q to start_obJectJd_norma1 of normaLstateJnfo of buttonjnfo(p), Is set as ID(q) (Step S85). 
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(0242) If the button Jnfo(p) corresponds to the current button, trie judgment of Step SB6 Is performed. 
[0243] Step SB6 Is for judging whether the current button is in active state. If the judgment Is In the affirmative, an 
identifier, obtained by adding the variable q to start_obJectJd_actloned of actloned_statejnfo of button Jnfo(p), Is set 
as ID(q) (Step S87). Then one of the button commands that are Included In button Jnfo(p) is executed (Step S86). 
s [0244] If the current button Is judged not to be In active state, an Identifier, obtained by adding the variable q to start_ 
object J deselected of selected.state Jnfb of button Jnfo(p), Is set as ID(q) (Step S89). 

[0245] In this way, once ID(q) is decided, the graphics object (p) that has the IO(q) and exists in the object buffer 15 
is written to the graphics plane 8, at a position Indicated by button_hor1zontal_pos1tion and button_vertlcaLposition of 
buttonJnfo(p) (Step S90). 

'<> [0246] Accordng to the above loop processing, qth frame of the plurality of graphics objects, which respectively 
constitute the selected state (or active state) of the current button and the normal state of the other buttons, will be written 
to the graphics plane 8. 

[0247] Step S91 is forjudging whether etarCobJectJd_normal+q has reached end_objeot Jd_normal. If the Judgment 
is In the negative, the variable "anlmation(p)" Is incremented by the variable q (Step S92) . If the judgment Is In the 
is affirmative, the variable N an1mation(p) w Is Initialized to have a value "0" (Step S93). The above-described processing Is 
repeated to all the buttonjnfo In the ICS (Step S81, Step S82). After completion of the processing for all the button^ 
info In the ICS, the operation returns to the main routine. 

[0248] By performing Step S80 - Step S93, the design Image for each button In the Interactive display will be updated 
to a new graphics object every time one loop of Step S35-Step S37 Is finished. If the loop of Step S35-Step S37 Is 
so performed many times, a so-called animation is realized, in the animation, the graphics controller 17 performs time 
adjustment so that the display interval for one frame of graphics object is set as a value Indicated by anlmatlon_f rame_ 
rate_code. 

[0249] In the above explanation, the button commands In button Jnfo(p) are executed one by one. However, it is also 
possible to execute all the button commands Included in button Jnfo(p) at a time, after all the graphics objects corre- 
25 sponding to the active state have been displayed. Next the processing procedure for (JO processing at Step S37 In the 
main routine is explained with reference to FIG.46. 

[0250] FIG. 46 Is a flowchart showing the processing procedure of the UO processing. In this flowchart processing, it 
is judged whether any of the phenomena of Step SlOO-Step S103 holds, and If It does, corresponding processing is 
executed, and the operation returns to the main routine. Step S 1 00 Is for judging whether UomaskTable Is set as 1 . If 

30 the judgment Is in the affirmative, the operation returns to the main routine without performing any processing. 

[0251 ] Step S 1 01 Is for Judging whether any of MoveUP/Down/Left/Rlght keys has been pushed. If the judgment Is in 
the affirmative, the current button la changed (Step S104), and It is judged whether auto_action_flag for the current 
button Is 01 (Step 51 06). If the Judgment Is In the negative, the operation returns to the main routine. If the judgment Is 
In the affirmative, the operation moves onto Step S1 05. 

35 [0252] Step S1 02 is for judging whether the activated key has been pushed, tf the judgment is in the affirmative, the 
current button i is changed to active state (StepSIOS). Then, the variable "anlmation(l)" is set as 0 (Step SI 06). 
[0253] Step S1 03 Is for judgingwhether it is a case of numerical value inputting, if the judgment is In the affirmative, 
numerical-value inputting processing Is performed (Step S107), and the operation returns to the main routine. Among 
the processing procedures in FIG. 46, Step SI 04 and Step S107 respectively have a structure aa a subroutine. The 

40 concrete processing procedures for the subroutines are shown In FIG. 47 end FIG. 48, As follows, these flowcharts are 
explained. 

[0254] FIG. 47 Is a flowchart showing the procedure of changing processing for a current button. First, in neighbor, 
info of the current button, one of upper_button_number, lower_button_number, lettJbutton_n umber, and rightj3utton_ 
number, which corresponds to the pressed key, Is identified (Step S1 10). 

45 [0255] Then, the current button is set as "button 1", and the new current button is set as "button J" (Step S1 1 1 ). Step 
Si 12 Is forjudging whether the button j set at Step S1 1 1 is Identical to the button 1. If they are Identical, the operation 
returns to the main routine, without performing any processing. If they are not Identical to each other, the button j Is set 
as a current button (Step S1 13), and the variables "animation 0) " and "animation (j)" are sat as 0. Then the operation 
returns to the main routine (Step S1 1 4). 

so [0256] FIG. 48 is a flowchart showing the procedure of numerical inputting processing, it is judged whether button 
info.j having the button_number that corresponds to the inputteo : nerical value exists (Step S121), and whether 
numertcally_selectable_flag of button Info.j is 1 Is Judged (Step 812.'. > If Step S121 and Step S122 result In Yes, the 
current button Is changed to normal state, and the button j is set as a current button (Step S123), and the variable 
"antmat1on(1) a and the variable "enimation(J)* are set as 0 (Step S124). Then it is judged whether auto_actionJlag of 

55' Button Info.j Is 1 (StepSI 25) . If It is not 1 , the operation returns to the main routine. 

[0257] If It is 1 , the current button is changed to active state at Step S 1 26, and then the operation returns to the main 
routine. 

[0258] If one of Steps S121-S123 Is No, the operation returns to the main routine. 
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[0259] When trying to perform interactive-display display using a user operation as a trigger (e.g. popup display), the 
stream graphics processor 1 4 and the graphics controller 1 7 perform the following processing, which is the same as the 
processing performed for synchronized display. According to this, the graphics object is obtained at the graphics plane 
8. After obtaining of graphics object In this way, It is waited until the current reproduction time reaches the time shown 
* by the PTS assigned to the ICS. Then after this reproduction time, once a UO Indicating a menu call Is received at the 
UO controller 18, the graphics object is outputted from the graphics plane 8 to the CLUT unit 9 for combining. By 
performing such outputtinging in synchronization with the UO, a popup display according to the pressing of the menu 
call Is realized. 

[0260] So far, how to set PTS in ICS; and DTS and PTS in ODS, where the ICS and ODS belong to a DSn, was 
io explained. However, DTS in ICS; DTS, PTS In PDS; and DTS, PTS In END have not been explained yet As below, 
these times tamps are explained. The ICS should be loaded to the Composition buffer 16, before: a decode start time 
of the first ODS (ODS1) in the DSn (i.e. DTS(DSn[ODS1 D) ; and before the first PDS (PDS1 ) in the DSn becomes valid 
(i.e. PTS(DSn[PDS1 ])). Specifically, the following relations should be satisfied. 

15 

DTS (DSn [ ICS ] ) *DTS (DSn [0DS1 ] ) 
DTS(DSn[ICS] )£PTS(DSn[PDSl] ) 



[0261] As follows, setting of DTS, PTS In each PDS belonging to the DSn Is described. 

[0262] Each PDS belonging to the DSn should be valid In the CLUT unit 9, between a time at which the ICS is loaded 
to the composition buffer 16 (DTS(DSn[ICS])) and a decode start time of the first ODS (DTS(DSn[ODS1])). Therefore 
23 for each of PTS values for PDS (PDS1 - PDSIast), the following relations should be satisfied. 

DTS ( DSn [ ICS ] ) * PTS (DSn [ PDSl ) ) 

so 

PTS (DSn [ PDS j ] )£PTS(DSri(PDSj+l] )£PTS{ DSn [PDSIast] ) 



* PTS ( DSn [ PDSIast ])*DTS (DSn [0DS1]) 

[0263] Note that even though not being referred to at reproduction, a DTS of a PDS will be set at the same value as 
a corresponding PTS, so as to comply with the MPEG2 standard. 

40 [0264] The following explains the meaning of DTS and PDS In the pipeline of a reproduction apparatus, once the DTS 
and the PDS are set so as to satisfy the above relations. FIG.49 is a diagram showing a pipeline In a reproduction 
apparatus, based on the DTS in the ICS, and the PTS In the PDS. FIG.49 is created based on FIG.33. "Reading to 
coded data buffer 13° found in the third row of FIG. 33 corresponds to the fifth row in the present drawing. In addition, 
D decoding by Stream Graphics processor 14° found in the second row corresponds to the fourth row In the present 

45 drawing. Moreover, the ICS and the PTS are set so as to satisfy the above-presented relations. 

[0265] The second row in FIG.49 Is a PDS setting to the CLUT unit 0. The third row shows a storage content of the 
composition buffer 16. The DTS In the ICS Is set at an earlier time than the DTS of the PDS or the DTS of the ODS. 
Therefore, as the arrow up1 shows In this drawing, loading of the ICS to the composition buffer 16 Is performed first of 
all. In addition, setting of PDS1 -last to the CLUT unit 9 is performed after transfer of the ICS and before decoding of the 

50 ODS1, and so Is set before the DTS of the ODS1, as the arrow up2 and up3 show In the drawing. 

[0266] As clear from the above, loading of ICS, and setting of PDS are done prior to decoding of ODS. 
[0267] Next, setting of PTS for "END of Display Set Segment" belonging to the DSn Is described. The End of the DSn 
indicates ending of the DSn, and so is to Indicate a decode end time of the last ODS(ODSIast) of the DSn. This decode 
end tlme Is indicated by the PTS of the ODSIast (PTS(DSh[ODSIast])). Therefore the PTS in the END should satisfy the 

55 following relation. 
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PTS(DSn[END] )-PTS(DSn(ODSlast] ) 

5 [0266] In relation to the iCSs belonging to DSn and DSn+1 , the ICS In the DSn Is loaded to the composition buffer 1 6 
prior to the loading time of the first ODS(ODS1), and so the PTS of the END should be after a loading time of ICS 
belonging to the DSn (DTS(DSn[lCS]», and before a loading time of ICS belonging to the DSn+1 (DTS(DSn+1[ICS])). 



10 DTS ( DSn [ICS) ) SPTS ( DSn [ END] ) ( DSn+1 ['ICS ) ) 

[0260] On the other hand, a loacfing time for the first ODS (ODS1) is after a loading time of the last PDS(PDSIast). 
And so PTS of END (PTS{DSn[EN D])) should be after a loading time of PDS belonging to the DSn belonging to the DSn 
75 (PTS(DSn[PDSi ast])). Therefore PTS of END should satisfy the following relation. 



PTS ( DS n [ PDS las t J ) *PTS ( DSn [ END ) ) 

20 

[0270] Next, the meaning of PTS of END In the pipeline of the reproduction apparatus is explained. FIQ .50 is a diagram 
showing the meaning of the END during operation of the pipeline of the reproduction apparatus. This diagram is created 
based on FIG.33, and almost all the rows therein are the same as those of FIG.33, except that the first row indicates 
the storage content of the composition buffer 1 6. In addition, FIG.50 renders two display sets, namely DSn and DSn+1 . 
25 in the DSn, the ODSIast is the last ODSn of A-ODSs, and so the PTS of the END Is set to indicate the PTS of this ODSn. 
The time shown by the PTS of this END Is earlier than the time shown by the DTS of the (CS in DSn+1. 
[0271] According to the PTS of this END, in reproduction, it becomes possible to know which time ODS loading with 
respect to DSn completes. 

[0272] Note that even though not being referred to at reproduction, a DTS of an END will be set at the same value as 

so a corresponding PTS, so as to comply with the MEPG2 standard. 

[0273] In the above structure, ICS. PDS, and ODS, In which DTS and PTS are set, are Incorporated Into an AV Clip 
In advance . This Is convenient for describing interactive control for having a reproduction apparatus to execute certain 
processing at which aframe of the motion picture appears on a screen, such Interactive control being closely synchronized 
with the content of a motion picture. In addition, in the above structure, ICS, PDS, and ODS are multiplexed to the AV 

35 clip Itself. Therefore even when the number of sections to be a reproduction control target is some hundreds, It Is not 
necessary to store all the corresponding ICS, PDS, and ODS. ICS, PDS, and ODS are read from a BD-ROM together 
with video packets. The procedure to be followed Is to read ICS, PDS, and ODS for a motion picture section that is to 
be reproduced at the moment onto the memory, and after completion of the reproduction ol this motion picture section, 
delete the ICS, PDS, and ODS from the memory, end then store a new set of ICS, PDS, and ODS corresponding to the 
next motion picture section, to the memory. According to the above structure, the occupied area of a memory Is limited 
to minimum even when the number of ICS, PDS, and ODS becomes some hundreds. 

[0274] As described so far, according to the present embocflme nt, there are 360 pages of ODSs for rendering animation. 
Under an assumption that there are three button-state sets, the ODSs will be grouped under three button -state sets 
(e.g. 120+120+120 pages). Each button-state set is placed so that the sat that appears earlier in the animation will be 

45 placed nearer to the top, and the set that appears later will be placed farther to the top. Accordingly, In reproduction, the 
earlier appearing button-state set will be loaded to the reproduction apparatus early, postponing loading of later appearing 
button-state sets. By doing so, when once reading/decoding of about 1/3-2/3 of the entire ODSs are complete, the 
preparation for an initial display Is ready, even though not all of the 360 pages of ODSs have not been finished being 
decoded. This further means that in a case when there Is an enormous amount of ODSs to be read/decoded, execution 

so of Initial display will notbedelayed. Aocordingto this, the Interactive dteplaywlth animation can beperformedwlthoutdeilay. 

(Second embodiment) 

[0276] The present embodiment relates to a production method of a BD-ROM. FIG.51 Is a flowchart showing the 
ss production method of the BD-ROM that relates to the second embodiment. 

[0276] The production method of the BD-ROM Includes: a material production process S201 In which material creation 
such as motion picture photographing and audio recording Is performed; an authoring process S202 In which an appli- 
cation format is generated using an authoring apparatus; and a press process S203 In which a master for the BD-ROM 
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is created by pressing and laminating, so as to complete the BD-ROM. 

[0277] Among these processes, the authoring process directed to a BD-ROM includes the following steps, Step 5204 
-Step 5209. 

[0278] First, at Step S204, animation for frames corresponding to button states are created, frame by frame, In a 

5 plurality ol pieces of graphics data In a plurality of run-length encoding method. 

[0279] At Step S205, the created pieces of graphics data are grouped under button states. Then an ICS Is created in 
which each button information specifies an identifier of a piece of graphics data. In creation, at Step S206, setting of 
default selected button ajvJ how to vary the states of buttons, are written to the ICS. At Step S207, the ICS and the 
grouped graphics data are Integrated Into a graphics stream. Once the graphics stream Is generated, at Step S208, the 

10 graphics stream Is multiplexed with a video stream and an audio stream created independently of the graphics stream, 
to obtain an AV Clip. Once the A V Clip Is obtained, at Step S209, a static scenario, an active scenario, and the AV Clip 
are made to comply with the BD-ROM format, thereby completing an application format 

[0280] As explained so far, according to the present embodiment, such a graphics stream as explained In the first 
embodiment Is generated by performing grouping of graphics data during the authoring process. This Is an easy way to 
15 generate an application format for a BD-ROM described in the first embodiment. 

(Third embodiment) 

[0281] The interactive graphics stream of the first embodiment is recorded onto a BD-ROM by being overiayed onto 
20 an AVCIlp. However, in the third embodiment, the interactive graphics stream is recorded tc a BD-ROM as a sub Clip 
separate from the AVCIlp, and the playllst Information Is used to associate the AVCIlp and the sub Clip. 
[0282] In the playllst information, the reproduction path formed by Play item Information is called •main path". In 
contrast, information indicating the sub Clip Is called sub-path Information and defines a reproduction path called "sub 
path". 

25 [0283] FIG.52 is a diagram showing an internal structure of PL information relating to the third embodiment 

[0284] The arrow hc1 in FIG . 52 focuses on each piece of sub-path information. As this arrow hc1 show, a piece of 
sub-path information is made of one or more sub Play Items. As the arrow hc2 In the drawing shows, each sub Play Item 
is made of "Clipjnformation Jilejriarne", •Cllp_codecJdentifler\ "Sub Ray Item Jn JTlme", "Sub Play ltem_Out_time\ 
"Sync_Play Item Jd", and •Sync_start_PTS_of PlayltemV 

so [0285] "Clipjnformatlon Jlle_name B Is a description of a file name of Clip information, which uniquely identifies a sub 
Clip corresponding to the sub Playltem. 

[0266] "Cllp^codecjdentifier" Indicates In which coding method the AVCIlp has been encoded. 
[0267] "SubPlayltemJn Jlme" Indicates a start point of the sub Ptayrtem on a reproduction time axis of the sub Clip. 
[0260] "SubPlayltem_Out Jime" indicates an end point of the sub Playltem on the reproduction time axis of the sub Clip. 
36 [0289] •Sync_Playitem_kr uniquely identifies one of Playltems constituting the main stream, with which the present 
sub Playltem Is to be synchronized. "Sub Play ltem_ln_time" exists oh the reproduction time axis of the Playltem identified v 
by this Sync J^layttemJcfY 

[0290] "Sync_starLPTS_of_Play Item" Indicates where on the reproduction time axis of the Playltem identified by the 
Syhc_Playltem Jd, the start point of the sub Playltem identified by the SubPlayltem jn Jlme exists. During reproduction 
40 of the Playltem, the sub Playltem will start being reproduced when the current reproduction time has reached this Sync_ 
stait_PTS_of_Piayltem. 

[0291] FIG.53 is a diagram schematically showing the synchronization of sub Playltem according to sync_Playltem_ 
id and sync_start_PTS of.Playltem. The main path in this drawing is made of Playltems #1 , #2, and #3. Sync_Playttem_ 
id and syrc_start_PTS_of_Playttem for the sub Playltem constituting the sub path are as shown within the frame drawn 

45 in a broken line of "wh1 ". Specifically, the sync_Playrtem Jd is set to indicate the Playltem#i , and the sync_starLPTS_ 
of_Playltem is set to Indicate the time t1 on the reproduction time axis for the Play Item. In this way, when the current 
reproduction time has reached t1 on the reproduction time axis of the Play Item, a part of the sub Clip (interactive graphics 
stream) identified by the cnpjnformation_file_narne will be reproduced, the part specifically corresponding to a part 
from the SubPlayltemJn Jlme to Sub_Playltem_Out_time. By performing reproduction in the above way, only a corre* 

50 sponding part from SubPlayrtemJn_time to SubPlaylterruOut Jlme within the interactive graphics stream will be syn- 
chronously reproduced with the AVCIlp. 

[0292] In addition, an Interactive graphics stream, being a sub Clip, may be recorded In an HD Included in the repro- 
duction apparatus. In this case, If playllst Information on the HD corresponds the AVCIlp on the BD-ROM and the sub 
Clip on the HD, then the AVCIlp and the sub Clip can be reproduced synchronously. FK3.54 is a diagram showing file 
55 identification by way of "Clip Jnformatlon_flle_name" in the playlist information on the HD. The arrows rf 1 , rf2 rf3 show 
Indications by CllpJnformatlonJ1le_name of Play Items In the playlist information. The arrows pfi, pf2, p!3 show indi- 
cations by Cllpjnformationjlle.name of sub Play Items in the playllst information. According to such indications by 
Cllpjnformation Jile^name, the sub path defined for the sub CBp on the HD is synchronously reproduced with the main 
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path defined for the main Clip on the BD-ROM. 

[0293] The following describes processing performed by the control unit 20. In the case where the sub Playltem to be 
synchronized with the current Playltem exists In the play list inform atlon. The control unit 20 controls the sub Clip indicated 
by the sub Playltem to be reproduced synchronously with the main Clip. This synchronous reproduction Is performed 
5 as follows. The picture data corresponding to the Sync_Start_PTS of_Playltem of the sub Playltem Is read from the 
main Clip. Then, the data existing between the SubPlayltemJn_tlme to the SubPlayltem-Outjlme of the sub Playltem 
Is reproduced. 

(Note) 

10 

[0294] The description so far does not show all the embodiments of the present Invention. Needless to say, the present 
Invention is also executable by various modifications, Including the following (A), (B), (C), (D), etc. Each invention relating 
to the claims of the present invention is either extended or generalized description of either the above-described em- 
bodiments or their modification examples. The degree of extension and generalization Is based on the level of the state 
is of art In this technological field, at the time of filing of the present Invention. Please note that each Invention In the claims 
reflects the means to solve the technological problems of the conventional technology, and therefore the scope thereof 
will not exceed the scope recognizable by a person in this technological field. Therefore each invention in the claims of 
the present invention Is substantially associated with the description of the present Invention. 

20 (A) All the embodiments have assumed that the recording medium according to the present Invention Is a BD-ROM. 

However, the recording medium of the present Invention is characterized by its graphics stream recorded therein, 
and this characteristic will not depend on the physical nature of the BD-ROM. Therefore the present invention Is 
applicable to any recording medium as long as ft can record an active scenario and a graphics stream. For example, 
the recording medium may be an optical disc such as a DVD-ROM, a DVD-RAM, a DVD-RW, a DVD-R, a DVD+RW, 

25 . a DVD+R, a CD-R, a CD-RW. The recording medium may also be an optical magnetic disc such as a PD and an 
MO. The recording medium may further be a semiconductor memory card such as a compact flash card, smart 
media, a memory stick, a multimedia card, a PCM-CIA card. Furthermore, the recording medium may be (I) a 
magnetic recording disc such as a flexible disc, a SuperDisk, a Zip, and a Cllkl, and (11) a removable hard disc drive 
such as an ORB, Jaz, a SparQ, a SyJet, an EZFley, and a micro drive. Still further, the recording medium may be 

30 a hard disc being a constituting element of an apparatus. 

(B) In all the embodiments, the reproduction apparatus first decodes an AV Clip recorded on a BD-ROM, before 
outputting It to a television. However, the reproduction apparatus may be designed as a BD-ROM drive, with the 
other elements provided for the television. In this case, the reproduction apparatus and the television can be lncor- 

35 porated into a home network connected through an IEEE1394. In addition, the reproduction apparatus according 

to the embodiments is a type which is used by being connected to a television. However, the reproduction apparatus 
may be an Integral-type with a display. Furthermore, only the substantial part of the reproduction apparatus of each 
of the embodiments may be considered the reproduction apparatus of the present invention. Because all such 
reproduction apparatuses are described In the present Invention's description, act of producing any of these repro- 

40 duction apparatuses based on the internal structure of the reproduction apparatus of the first embodiment constitutes 

an apt of practicing the present Invention as described In' the description. Any act of transfer whether with charge 
or not (sales if with charge, and gifts If not with charge), rent, and import relating to the reproduction apparatus of 
the first embodiment also constitute an embodiment of the present invention. In addition, any act of offering these 
transfer and rent, through storefront display, catalogue solicitation, and pamphlet distribution, also constitutes an 

<s act of practicing the present reproduction apparatus. 

(C) The Information processing according to the program shown in each of the flowcharts is executed using hardware ^ 
resources. Accordingly, each program whose processing procedure Is described by way of the flowcharts Is an 
invention by itself. The above embodiments describe the cases where the programs are Incorporated in the repro- 

50 duction apparatus, but the programs can be used independently of the reproduction apparatus. Acts of executing 

the programs Include (1 ) an act of producing, (2) an act of transferring with or without charge, (3) an act of renting, 
(4) an act of Importing, (5) an act of providing for the public via a bl-dlrectional electronic communications network, 
and (6) an act of offering for transfer or rent using storefront displays, catalogs, or pamphlets. 

55 (D) Information processing using the programs shown In the flowcharts Is actually realized using hardware resources. 

Accordingly, the programs which describe the operational procedures shown in the flowcharts are themselves an 
Invention. The above embodiments describe the cases where the programs are Incorporated In the reproduction 
apparatus, but the programs can be used Independently of the reproduction apparatus. Acts of practicing the pro- 
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grams Include (1 ) an apt of manufacturing, (2) an act of transfer with or without charge, (3) an act of leasing, (4) an 
act of Importing, (5) an act of providing to the public via a bi-directional electronic communications network, and (6) 
an act of offering the public for transfer or lease using storefront displays, catalogs, or brochures. 

(E) When recording an AV Clip on the BD-ROM, ah extension header may be added to each TS packet In the AV 
Clip. The extension header is called a TP_extra_header , includes an arrivaLtime_6tamp and a copy jperrriission_ 
indicator, and has a data length of 4 bytes. TS packets with TP_extra_headers (hereafter *EX TS packets") are 
grouped In units of 32 packets, and each set is written to three sectors. One set made up of 32 EX TS packets has 
6,144 bytes (=32 x 1 92), which is equivalent to a size of three sectors that is 6,144 bytes (=2,048 x 3). The 32 EX 
TS packets contained in the three sectors are called an Aligned Unit. 

In a home network connected with an IEEE 1 394 connector, the reproduction apparatus 200 transmits an Aligned 
Unit In the following manner. The reproduction apparatus removes a TP__extra_header from each of the 32 EX TS 
packets In the Aligned Unit, encrypts the body of each TS packet according to the DTCP Specification, and outputs 
the encrypted TS packets. When outputtlng the TS packets, the reproduction apparatus Inserts an isochronous 
packet between adjacent TS packets. A point where the isochronous packet is Inserted is determined based on a 
time shown by an arrtval_time_stamp of the TP_extra_header. The reproduction apparatus 200 outputs a DTCP_ 
descriptor, as well as theTS packets. The DTCP_descrlptor corresponds to a copy_permission ^Indicator in the TP_ 
extrajieader. With the provision of the DTCP_descriptor indicating "copy prohibited", It is possible to prevent, when 
using the TS packets In the home network connected with the IEEE 1394 connector, the TS packets from being 
recorded to other devices. 

(F) The above embodiments describe the cases where an AV Clip of the BD-ROM Format Is used as a digital stream, 
but the present invention can also be realized with a VOB (Video Object) of the DVD-Video Format or the DVD- 
Video Recording Format The VOB is a program stream that complies with the 1 SO/I EC 13818-1 Standard and Is 
obtained by multiplexing a video stream and an audio stream. Also, the video stream in the AV Clip may be an 
MPEG4 video stream or a WMV video stream. Further, the audio stream in the AV Clip may be a Linear PCM audio 
stream, a Dolby AC-3 audio stream, an MP3 audio stream, or an MPEG-AAC audio stream. 

(G) The video editing described in the above embodiments may be obtained by encoding an analog image signal 
30 broadcast by analog broadcasting. 

Alternatively , analog/digital image signals recorded on a videotape may be encoded to obtain contents. Also, analog/ 
digital Image signals directly captured by a video camera may be encoded to obtain contents. A digital work distiibuted 
by a distribution server Is applicable too. 

35 (H) Graphics objects described In the above embodiments Is run-length encoded raster data. Run-length encoding 

is used for compression/encoding of graphics objects, because the run-length encoding is suitable for compression 
and decompression of subtitles. Subtitles have a property In that a continuous length of the same pixel value in a 
horizontal oSrection is relatively long. Therefore, by performing compression using run-length encoding, a high 
compression rate can be attained. In addition, run-length encoding reduces a load for decompression, and is therefore 

40 suitable for realizing decoding by software. Nevertheless, the use of run-length encoding for graphics objects is not 

essential to the present invention. For example, graphics objects may be PNG data. Also; graphics objects may be 
vector data instead of raster data. Further, graphics objects may be transparent patterns. 

(I) In a case where plural reproduction paths joint to one another, and that the default selected button changes 
45 depending on which reproduction path is to be taken, the following arrangement Is preferable. That Is, reproduction 

control In the dynamic scenario is described so that atthe time when each reproduction path is passed, the eigenvalue 
for the reproduction path is set at the register of the reproduction apparatus, and that the reproduction processes 
are described so that buttons will be set in a selected state according to the values set in the register. By this 
arrangement, the button to be in a selected state can be changed according to which reproduction path Is to be passed. 

so 

(J) When the BD-ROM or the HD has a plurality of interactive graphics streams, which are each sub Clips, It Is 
possible to provide STN_Table within the Play Item Information of the playRst information, the STN.Table showing 
which of the interactive graphics streams should be selected. Moreover, it is possible to use entries In the STN_ 
table within the Playltem information^ for the purpose of prioritizing among the Interactive graphics streams. 

55 

Industrial Applicability 

[0295] A recording medium and a reproduction apparatus according to the present invention realize interactive control 
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on movie works, and so help provide the market with movie works of high added values, which helps Invigorate the 
movie market and the consumer goods market Accordingly, the recording medium and the reproduction apparatus 
according to the present Invention are highly applicable In the movie Industry and the consumer goods industry. 



Claims 

1, A recording medium c uprising: 

10 a graphics stream which represents an interactive display Including a plurality of graphical button materials to 

be overlayed with a modon picture wherein: 

said graphics stream includes a plurality of graphics data sets and a control Information which controls 
states of each of said graphical button materials each having at least a normal state, a selected state and 

is an active state; and 

said plurality of graphics data sets comprise a first graphics data set forming a group of graphics data for 
rendering the normal state, a second graphics data set forming a group of graphics data for rendering the 
selected state, and a third graphics data set forming a group of graphic data for rendering the active state; 
said first, second and third graphics data sets are disposed in a sequential order, 

a> said control Information Includes Information indicating one of said graphical button materials which Is to 

be set In said selected state as a default can be changed dynamically. 

2. The recording medium of Claim 1 , further comprising play list Information, wherein: 

25 said play list information includes main-path Information and sub-path information; 

said main-path Information indicates a video stream as a main stream and defines a reproduction section of 
the main stream; 

said sub-path Information indicates said graphics stream as a sub stream which synchronizes with said main 
stream, defines a reproduction section of said sub stream and includes reproduction information; 
30 said reproduction information indicates a synchronization point on a reproduction time axis of said main stream; 

and 

said interactive display is represented to be overlayed with a picture of said video stream In said reproduction 
section of said main stream. 

36 3. The recording medium of Claim 2, further comprising aread-only optical disk, wherein: 

said video stream Is recoded on a read-only optical disk; and 

said graphics stream and said play list Information are recorded on said recording medium which is a rewritable 
disk. 

40 

4. A reproduction apparatus for reproducing a video stream and a graphics stream, said apparatus comprising: 

a graphics decoder operable to decode the graphics stream and obtain an interactive display including a plurality 
of graphical button materials, wherein: 

45 

the graphics stream Includes a plurality of graphics data sets and a control information which controls states 
of each of the graphical button materials each having at least a normal state, a selected state and an active 
state; and 

the plurality of graphics data sets comprise a first graphics data set forming a group of graphics data for 
so rendering the normal state, a second graphics data set forming a group of graphics data for rendering the 

selected state, and a third graphics data set forming a group of graphic data for rendering the active state; 
the first, second and third graphic data sets are disposed In a sequential order; 

the control information includes information Indicating one of the graphical button materials which Is to be 
set In the selected state as a default can be changed dynamically; and 
55 said graphics decoder includes: 

a graphics processor operable to decode the graphics data; 

an object buffer operable to store decompressed graphics data obtained by the decoding; and 
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a graphics controller operable to write the decompressed graphics data to the graphics plane. 

6. The reproduction apparatus of Claim 4, further comprising a video decoder which decodes the video stream and 
reads play list Information recorded on a recorcfing medium, wherein: 

the play list Information Includes main-path Information and sub-path information; 

the main information Indicates the video stream as a main stream and defines a reproduction section of the 
main stream, the video stream includes pictures; 

the sub-path information indicates the graphics stream as a sub stream which synchronizes with the main 
to stream, defines a reproduction section of the sub stream and Includes reproduction Information; 

the reproduction information Indicates a synchronization point on a reproduction time axis of the mainstream; and 
the interactive display is represented to be oveiiayed with a picture of the video stream in the reproduction 
section of a main stream. 

15 6. The reproduction apparatus of Claim 5, wherein: 

the video stream is recorded on a read-on ry optical disk; and 

the graphics stream and the video stream are recorded on a recording medium which is a rewritable disk. 
so 7. A recording method for recording to a recording medium, said method comprising: 
creating application data; and 

recording the created application data to the recording medium; wherein: 
the application data includes a graphics stream; 

the graphics stream represents an interactive display to be overlayed with a motion picture, the interactive 
display including a plurality of graphical button materials; 

the graphics stream Includes a plurality of graphics data sets and a control information which controls states 
of each of the graphical button materials each having at least a normal state, a selected state and an active 
state; and 

the plurality of graphics data sets comprise a first graphics data set forming a group of graphics data for 
rendering the normal state, a second graphics data set forming a group of graphics data for rendering the 
selected state, and a third graphics data set forming a group of graphic data for rendering the active state; 
the first, second and third graphic data sets are disposed In a sequential order; and 
the control Information includes Information indicating one of trie graphical button materials which is to be 
set in the selected state as a default can be changed dynamically. 

8. A program embodied on a computer readable medium for enabling a computer to reproduce a .graphics stream, 
said program comprising code operable to cause the computer to perform: 

40 

a decoding of the graphics stream; and 

a displaying of an interactive display, the Interactive display including a plurality of graphical button materials; 
wherein: 

"! * 

45 the graphics stream includes a plurality of graphics data sets and a control information which controls states 

of each of the graphical button materials each having at least a normal state, a selected state and an active 
state; and 

the plurality of graphics data sets comprise a first graphics data set forming a group of graphics data for 
rendering the normal state, a second graphics data sat forming a group of graphics data for rendering the 
so selected state, and a third graphics data set forming a group of graphic data for rendering the active state; 

the first, second and third graphic data sets are disposed in a sequential order, 

the control information Includes Information Indicating one of the graphical button materials which is to be 
set in the selected state as a default can be changed dynamically; and 
the computer Includes: 
55 ... 

a graphics processor operable to decode the graphics data; 

an object buffer operable to store decompressed graphics data obtained by the decoding; and 
a graphics plane operable to store at least some of the decompressed graphics data, 
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wherein the decompressed graphics data is written to the graphics plane. 

A method of reproducing a graphics stream which represents an interactive display Including a plurality of graphical 
button materials, said reproduction method comprising: 

decoding the graphics stream, wherein: 

the graphics stream Includes a plurality of graphics data sets and a control Information which controls states 
of each of the graphical button materials each having at least a normal state, a selected state and an active 
state; and 

the plurality of graphics data sets comprise a first graphics data set forming a group of graphics data for 
rendering the normal state, a second graphics data set forming a group of graphics data for rendering the 
selected state, and a third graphics data set forming a group of graphic data for rendering the active state; 
the first, second and third graphic data sets are disposed in a sequential order, 

the control Information Includes information incficatlng one of the graphical button materials which is to be 
set in the selected state as a default can be changed dynamically: and 
said decoding Includes: 

decoding the graphics data; 

storing decompressed graphics data obtained by the decoding onto an object buffer 
storing at least some of the decompressed graphics data onto a graphics plane; and 
writing the decompressed graphics data to the graphics plane. 
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(54) Recording medium, reproduction device, recording method, program, and reproduction 
method 



(57) ABD-ROMhasrecordedtherelnanAVCHpgen- 
erated by multiplexing a video stream ano! a graphics 
stream. The graphics stream represents an interactive 
display to be overlayed with the video stream, and in- 
cludes a sequence of three; Button State groups. The 
interactive display includes a plurality of buttons, each of 
which changes from a normal state to a selected state, 
and from the selected state to an active state, according 



to a user operation, in the three Button State groups in 
the graphics stream, the first-order group (N-ODSs) Is 
made of a plurality of pieces of graphics data, which rep- 
resent normal states of the buttons, the seconds rder 
group (S-ODSs) Is made of a plurality of pieces of graph- 
ics data, which represent selected states of the buttons, 
and the third-order group (A-ODSs) Is made of a plurality 
of pieces of graphics data, which represent active states 
of the buttons. 



RG.22 



3 

O 
00 

$ 

Q. 
HI 



- rrnr i n ayto *,,! j ii i ' i i .- 11 . ■■ . 



Printed by Jouve, 75C01 PARIS (Fft) 



6DOCID:<EP_ 



^1868ieOA3J _?> 



EP 1 868 190 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



. Application Number 

EP 07 11 6962 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with In cOoatkon, where appropriate, 
of relevant paaeagee ■ 



Relevant 
to claim 



CLASSIFICATION OP THE 
APPLICATION (IPC) 



EP 0 898 279 A (SONY CORP [JP]) 
24 February 1999 (1999-02-24) 
* the whole document * 



EP 1 463 052 A (THOMSON BRANDT GMBH 
29 September 2004 (2004-09-29) 
* the whole document * 



[DE]) 



1-9 



1-9 



The present search report has teen drawn up for all otelma 



Piece of oeoroh 

The Hague 



- Date of oofflplBlbnri ttoeoaioh . 

2 January 2008 



INV . 

H04N5/91 

H04N5/92 

606T13/00 

G11B27/34 

G11B19/02 

G11B27/034 

G11B27/30 

GUB27/32 

H04N9/82 



TECHNWAL FIELDS 
SEARCHED (IPC) 



G11B 



Benfieldp Alan 



CATEGORY OP CITED DOCUMENTS 



T:th»oryorprtnotpl» underlying <he invention 
E : MritorpelMitclaouimnt, but published on, o 



Y : particularly mlavent If combined with another 



titno d* 
rrtoTt»d 



A : tMhnologio^biBOkoround 



A : rot mb+r of the terna petMit twnHy, ooneopondbig 



2 



1868190A3J_> 



EP 1 868 190 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 

ON EUROPEAN PATENT APPLICATION NO. EP 07 11 6962 



This annex lists the patent family members relating to the patent documents cited in the above-mentioned European search report. 
The members are as contained h the European Patent Offioe EDP file on 

The European latent qffioe is in no way liable for these particulars which are merely given tor the purpose of information. 

02-01-2098 



Patent document 




Pubioolion 




Patent famify 


Publication 


cited In search report 




date 




member(s} 


date . 


EP 0898279 


A 


24-82-1999 


CN 


1212569 A 


31-03-1999 






CN 


1553447 A 


08-12-2004 








CN 


1909104 A 


07-02-2007 








DE 


69834872 T2 


11-01-2007 








JP 


11069284 A 


09-03-1999 








US 


6469718 Bl 


22-10-2002 


EP 1463952 


A 


29-89-2664 


AU 


2064223253 Al 


07-10-2604 








BR 


PI6468597 A 


21-63-2666 








CA 


2517660 Al 


07-10-2604 








CN 


1774754 A 


17^05-2006 








WO 


2004086392 Al 


07-10-2004 








JP 


2006521607 T . 


21-09-2006 








KR 


20060002852 A 


O9-01-2OO6 








MX 


PA05O1Q176 A 


08-11-2605 








US 


2006215987 Al 


28-69-2606 



) For more details about this annex : see Official Journal of the European Patent Office, No. 12/82 



3 



1B6S190A3J_> 



